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AN ASSESSMENT OF FEDERAL FUNDING FOR 
PRIVATE RESEARCH AND DEVELOPMENT 


THURSDAY, MAY 26, 2005 

U.S. Senate, 

Subcommittee on Federal Financial Management, 

Government Information, and International Security, 

OF THE Committee on Homeland Security 
AND Governmental Affairs, 
Washington, DC. 

The Subcommittee met, pursuant to notice, at 2:37 p.m., in room 
SD-562, Dirksen Senate Office Building, Hon. Tom Coburn, Chair- 
man of the Subcommittee, presiding. 

Present: Senators Coburn, Carper, Levin, and Lieberman. 

Chairman CoBURN. The Subcommittee will come to order. I 
thank each of you for attending. 

OPENING STATEMENT OF SENATOR COBURN 

Senator Coburn. Last year, venture capitalists in this country, 
through the private sector, invested over $20 billion in various 
projects in the United States. The Federal Government outside the 
ATP program invested over $50 billion in research. 

The hearing today is not to say that there are not some good 
things that come out of every government program, but is to assess 
the relative dollar contribution versus the benefit of the programs 
that we are investing in. 

I think one of the things that every American can agree on is 
that having a deficit each year, and I would preface that the last 
time we had a real surplus in our country was 1973. All you have 
to do is look at the national debt to assess whether or not that is 
a true statement because it rose in each of those years. 

The fact is this year it will be over $620 billion. The only thing 
that lasts longer than life are government programs. The purpose 
of this hearing today is to take a good hard look at one of those 
particular programs that has been recommended for elimination 
through President Bush’s budget recommendation, and assess and 
evaluate the quality, the impact and the potential future impact 
and cost benefit for that program. 

With that in mind, I will ask for unanimous consent that my en- 
tire opening statement be made a part of the record and I would 
introduce to you our Ranking Member, Senator Carper and ask for 
his opening statement. 

[The prepared statement of Senator Coburn follows:] 

( 1 ) 
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PREPARED OPENING STATEMENT OE SENATOR COBURN 

Last year, venture capitalists invested over $20 billion into various projects in the 
U.S. economy. Industries including biotechnology, telecommunications, and health 
care services received hundreds of millions, if not billions, of dollars in funding from 
private investors. All of that venture capital funding also doesn’t even take into ac- 
count the massive amount of money spent each year on research and development, 
or R&D, hy publicly-traded American companies. Just to give a few examples, IBM 
in 2004 spent more than $5 billion on R&D, while Motorola spent more than $3 bil- 
lion on R&D. In short, the private sector of the U.S. economy is researching new 
technologies and products at a feverish pace. 

This hearing today has been convened to provide an assessment of Federal fund- 
ing for private research and development, with a focus on the Advanced Technology 
Program, or ATP. Created in 1988 by the Omnibus Trade and Competitiveness Act, 
ATP is a Federal program charged to support research that accelerates the develop- 
ment of high-risk technologies in order to increase the global competitiveness of 
American industry. On its web site, ATP states that its goal is to help companies 
meet challenges that “they could not or would not do alone.” Many of the program’s 
most vocal supporters believe that without the Federal funding provided by ATP, 
countless research projects would receive no money at all, and that ATP exists to 
remedy the failure of the market to fund research and development. 

Evidence to support those claims, however, is quite limited. Time after time, ATP 
is shown to fund initiatives that have already been undertaken by the private sec- 
tor. Year after year, multi-billion dollar corporations receive millions of dollars from 
ATP. For example. General Electric, or GE, one of the most widely known corporate 
brands in the world, has received more than $100 million in grants from ATP. Last 
year alone, GE reported revenues of $152 billion. IBM, with revenues of nearly $100 
billion in 2004, has received $91 million in Federal funds from ATP. In total since 
1990, Fortune 500 corporations have received more than $730 million from ATP. If 
this does not constitute corporate welfare, then corporate welfare does not exist. 

Regarding the claim that ATP primarily funds research that does not already 
exist in the private sector, the U.S. Government Accountability Office (GAO), found 
in a 2000 report that ATP had funded research on handwriting recognition that 
began in the private sector in the late 1950s. GAO found that inherent factors with- 
in ATP made it “unlikely that ATP can avoid funding research already being pur- 
sued by the private sector in the same time period.” Furthermore, according to the 
Program Assessment and Rating Tool used by the Office of Management and Budg- 
et, ATP does not address a specific need and is not designed to make a unique con- 
tribution. 

While many supporters of ATP point to the broad societal benefits of scientific re- 
search as justification for ATP, the merits of scientific research are not at issue here 
today. As a physician, I know first-hand the benefits that have been realized due 
to breakthroughs in the field of medical research. The main issues before us today 
are the Federal financing of research that may very well be duplicative and the Fed- 
eral subsidization of multi-billion dollar global corporations. 

We are pleased to have with us here today distinguished scholars from the Gov- 
ernment Accountability Office, the Heritage Foundation, and the National Acad- 
emies. On our first and only panel, Robin Nazzaro, Brian Reidl, and Dr. Charles 
Wessner will give us their assessments of Federal funding of private research and 
development. 

OPENING STATEMENT OF SENATOR CARPER 

Senator Carper. How is that for timing. It is not always that 
good. 

I just left about 50 screaming kids from Cab Calloway School in 
Delaware in my office, saying do not go to that hearing, stay here 
and take our questions. I thought I would come here and ask some 
questions of my own. 

To our witnesses today, welcome and thanks for joining us. 

I think this is my fifth hearing today and I think it is the last 
one. 

Senator Coburn. You were not in a 5-hour markup for asbestos. 
Senator Carper. How did that go? 

Senator Coburn. It is going to the floor. 
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Senator Carper. That is exciting. 

I have actually quite a long statement here and rather than go 
through it, if I could, let me just ask unanimous consent to enter 
it for the record and we will just get right to these witnesses and 
get this show on the road. Thank you. 

Senator Coburn. Without objection. 

[The prepared statement of Senator Carper follows:] 

PREPARED OPENING STATEMENT OF SENATOR CARPER 

Thank you, Mr. Chairman. I appreciate the dedication you’ve shown so far in 
using this subcommittee to closely examine programs — even very popular ones — to 
make sure that the taxpayer dollars we dedicate to them are spent wisely and are 
getting results. 

There’s probably room for improvement in every program. I’m sure the Advanced 
Technology Program is no exception. I think it’s clear, however, that ATP has been 
a success. I think it’s also clear that ATP and programs like it should be seen as 
an integral part of our nation’s economic policy, especially in times like these with 
U.S. industry under so much pressure from overseas competition. 

A recent assessment of ATP conducted by the National Academies shows that the 
program is achieving the goals Congress set out for it when it was created back in 
the late 1980s. According to the panel’s findings, “The ATP emphasizes economic 
growth and advances the competitiveness of U.S. firms by fostering technologies 
with potentially large net social value that might not otherwise emerge in time to 
maximize their competitive value.” 

I know there are some critics of ATP who would disagree with this assessment. 
I believe GAO will testify today that flaws in the program’s application review proc- 
ess may lead to the funding of research projects that duplicate work already being 
done in the private sector without ATP assistance. There have been others who’ve 
criticized ATP for giving too much assistance to large companies or concentrating 
it in a handful of states. Others say ATP simply isn’t needed and that much of the 
work it funds would happen with or without its help. I think some of this criticism 
misses the point. 

Data collected by ATP’s Economic Assessment Office shows the projects funded 
under the program have had a real economic impact across the country. ATP has 
funded projects in 40 states across the country, plus the District of Columbia. The 
vast majority of these projects were led by small businesses. 

The Economic Assessment Office was able to analyze the impact a few dozen ATP- 
funded projects more closely and learned that they provided American taxpayers a 
return on investment of some $17 billion. When you consider that ATP has only dis- 
tributed about $2 billion in grants since it’s founding I’d say that’s an example of 
remarkable success. 

In simple terms, I think ATP’s mission is to find good ideas and help turn those 
ideas into something that can benefit our economy. It shouldn’t matter where those 
ideas come from. And I don’t know that it would ever be possible to guarantee that 
a company receiving an ATP grant would never be able to get funding for their 
project through some other means. 

It’s clear to me that there are some good ideas out there that private venture cap- 
ital firms probably won’t touch. If those ideas have merit, I think the Federal Gov- 
ernment, through ATP or some other means, should try to help them along. 

ATP has probably made some bad funding decisions in the past, Mr. Chairman, 
and I’m sure they’d acknowledge that themselves. They’ll probably make more in 
the future. That’s the nature of what they do — some research projects bear fruit, 
others don’t. But the program is making an impact in a number of ways. The Eco- 
nomic Assessment Office found that ATP grants in most cases help bring products 
to market faster. Grant recipients are able to obtain more patents and hire more 
people. Growth for small firms that receive ATP funds is apparently quite dramatic. 
Fifty-nine small firms surveyed by the Economic Assessment Office doubled in size 
after receiving ATP grants. A handful of others grew even more. 

Mr. Chairman, I’ll close with this. Just over 6 years ago now, when I was serving 
as Governor of Delaware, I asked the General Assembly for $15 million to start up 
the Delaware Biotechnology Institute. What we were seeking to do was to create a 
partnership involving the State Government, the academic community, and the pri- 
vate sector — a partnership that would put Delaware at the forefront of research, de- 
velopment and the commercialization of new life science products. We also sought 
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to work with our partners to create and retain quality jobs and help our State better 
compete with our neighbors and with other States in the biotechnology field. 

I also worked as Governor to help create the Delaware Technology Park — a part- 
nership between the State, the University of Delaware and the private sector that 
gives technology companies — both small and large, some of them start-ups — a place 
to grow their businesses. 

I’m proud to say that the Delaware Biotechnology Institute and the Delaware 
Technology Park are still working to keep jobs in my State and make it a place 
where companies and researchers involved in science and technology want to come 
to do business. 

I think these snapshots of what’s happening in one small State in the economic 
development arena show the kind of good that government intervention like ATP 
can do — and are doing. When I was Governor, I thought a major part of my job was 
to help grow our economy and attract quality, well-paying jobs. I think ATP does 
similar work for our Nation as a whole. 

Thank you again, Mr. Chairman. I look forward to hearing from our witnesses 
and to discuss ATP’s work further. 

Senator Coburn. We are going to have one panel today, so I 
would like to introduce our panel of witnesses. Robin Nazzaro has 
been with GAO since 1979, has a wealth of audit experience, as 
well as an incredibly diverse array of issue expertise. For several 
years she worked on tax and financial management issues and 
later in the area of information technology. 

Most recently, Ms. Nazzaro oversaw GAO’s work on federally 
funded research and development, including responsibility for re- 
search into the National Institute of Technology and the National 
Science Foundation. 

Also here today is Brian Riedl, who currently serves as Grover 
M. Hermann Fellow for Federal Budgetary Affairs at the Heritage 
Foundation. Mr. Riedl’s research has been featured in the New 
York Times, the Wall Street Journal, the Washington Post, a myr- 
iad of other publications. 

Before coming to Washington, Mr. Riedl worked as a policy ana- 
lyst for Governor Tommy Thompson of Wisconsin. 

Our first witness to present today is Dr. Charles Wessner, es- 
teemed Director of the National Research Council. He has a long 
history of public service, having worked for the Department of 
Treasury, the U.S. Diplomatic Corps, the Organization of Economic 
Cooperation and Development (OECD), in Europe. Dr. Wessner 
currently works as Director for Technology and Innovation at the 
National Academies. 

In the interest of time, your full statements will be made a part 
of the record and I would ask that you try to limit your testimony 
to 5 minutes and we will give you a chance to offer additional com- 
ments as we start the questions back and forth. 

Dr. Wessner, if you would please begin. 

TESTIMONY OF CHARLES W. WESSNER, PH.D.,i DIRECTOR FOR 

TECHNOLOGY AND INNOVATION, BOARD ON SCIENCE, TECH- 
NOLOGY AND ECONOMIC POLICY, THE NATIONAL ACAD- 
EMIES 

Dr. Wessner. Thank you very much. Senator. It is an honor to 
be here to speak before you both. And I would like very much to 
welcome your suggestion that we take a hard look at the program. 


^The prepared statement of Dr. Wessner with an attachment appears in the Appendix on 
page 37. 



5 


Indeed, at the National Academies, one of the things that we spe- 
cialize in is advising the Congress with hard looks at programs. A 
hard, that is to say, objective look is our goal. 

My goal specifically today is to talk to you briefly about what the 
Advanced Technology Program (ATP) is, what it is not, and why it 
is important to continue supporting what we have found to be an 
innovative and effective program. In the course of that discussion. 
Senator, I would hope we would have the opportunity also to ex- 
plore some of the myths and realities about innovation in the 
United States. 

Let me say first off that the National Academies’ assessment of 
ATP was conducted under the leadership of Gordon Moore of Intel. 
It found that the ATP is meeting its mission goals. In short, we 
found after careful analysis that the program contributes to our 
Nation’s innovation, economic growth and national security. 

The good news is that ATP investments are already yielding high 
returns. Innovative technologies for knee repair and early breast 
cancer detection enable more productive lives and can lower med- 
ical cost. ATP has also helped to fund work on supporting U.S. 
manufacturing, such as printed wiring boards, and supported 
promising new technologies ranging from fuel cells to DNA 
diagnostics that will potentially revolutionize drug discovery. 

There are a lot of common questions about ATP, and let me go 
to some of them. Let me first quote a promising young entre- 
preneur in Silicon Valley. She was asked why the government 
should fund the development of enabling technologies. And since 
you can read faster than I can talk, I thought I might just let you 
take a look at Elizabeth Downing’s point. Elizabeth Downing, 3D 
Technology Laboratoris, NRG Report, states on page 65, “Why 
should the government fund the development of enabling tech- 
nologies? Because enabling technologies have the potential to bring 
enormous benefits to society as a whole. Yet private investors will 
not adequately support the development of these technologies be- 
cause profits are too uncertain or too distant.” 

We all recognize the potential of new innovative technologies. 
The problem is that private investors cannot adequately support 
them, and for good reason. One of the things that troubles me is 
people often refer to this as just a government program, picking 
winners and losers. The point is that the program is industry driv- 
en. Unlike many research programs in the Federal Government, 
the projects have to be proposed by industry, they are directed and 
carried out by industry, they are funded by industry on a cost- 
shared basis. This is why the program was adopted on a bipartisan 
basis when it was established. The awards often serve a catalytic 
function, bringing together partners from large companies and from 
small companies as well as universities. 

The bulk of the ATP awards, nearly 70 percent, go to small busi- 
nesses. Why is that important? Because small business drives inno- 
vation, employment and growth in the U.S. economy. 

Does the program work well? Yes, it does. How do we know this? 
We know this because the ATP program, ironically, is the most in- 
tensively studied, rigorously scrutinized, and carefully assessed of 
any of the U.S. technology programs over the past 50 years. By 
itself, the National Academies’ review consumed 2 years, three 
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major meetings, two major reports and numerous detailed studies 
led by a 15-person steering committee chaired by Gordon Moore. It 
involved leading economists and wide consultations with the ven- 
ture community, corporations, small companies, and government 
officials. 

Why do I tell you that? Because the conclusions that we reach 
here today about the program were done laboriously, carefully and 
according to the highest standards of the Academy. 

One of the things I would like to draw to your attention is a com- 
mon myth. Many in the policy world believe that because we have 
a robust venture capital market, VC finance alone is the solution 
to many of the challenges of early-stage finance. 

But I think what you may realize is that, as Congressman Verne 
Ehlers pointed out years ago, there is actually a valley death where 
it is very difficult to take the ideas from federally funded research 
and take them across the valley to the promised land, as it were, 
of product development, innovation and commercialization. These 
problems are especially severe for risky but promising new tech- 
nologies. 

One of the things to recognize are the limitations of venture cap- 
ital. Basically, venture capitalists are not focused on early-stage fi- 
nance. This is not a failing. They are not supposed to be focused 
on early-stage finance. The venture capital goal is not to develop 
the U.S. economy in the abstract. The goal of venture capital funds 
is to have a return on the funds that are given to them by their 
investors. If you look at this pie chart, ^ you can see that the seed 
funding available is actually quite small. 

I would like to quote a member of our board, David 
Morgenthaler, who is one of the past presidents of the National 
Venture Capital Association. David Morgenthaler, Morgenthaler 
Ventures, NRC Report, on page 66 states, “[The ATP] is an excel- 
lent program for developing enabling, or platform, technologies, 
which can have broad applications but are long-term, risky invest- 
ments.” 

“Venture capitalists are not going to fund these opportunities, be- 
cause they will feel that they are at too early a stage of maturity. 
Government can and should fund these technologies. In fact, it 
should do more than it is doing.” 

What he points out there again is simply that the program is an 
excellent program. It is one that has proven itself, and it is one 
that venture capitalists endorse. 

There is also another myth about the program. Some still ask 
“would not private capital support an ATP project anyhow?” The 
short answer is “usually not.” Why? Because the type of projects 
that ATP invests in are usually too risky, the technology often re- 
quires competencies that are not controlled by one firm, or the cost 
is simply too high. These are the very factors that the program ad- 
dresses. Our research supports this view. 

Looking at 1998 ATP applicants one year after, NRC researchers 
found most of the non-winners had not proceeded with their re- 
search. 


^The pie chart entitled “Large U.S. Venture Capital Market is Not Focused on Early-Stage 
Firms,” submitted by Dr. Wessner appears in the Appendix on page 41. 
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I realize that my time is short here but I would like to emphasize 
that we are not alone. There are a variety of programs around the 
world like ATP. One of the analogies that I like is that I am not 
sure I would actually favor the Air Force in the abstract, sir. But 
if other countries have an Air Force, I think it is a jolly good idea 
that we have one, too, and that it be the best. 

The list below describes some of the Chinese programs in the 
semiconducter sector. 

There is the related problem with some of the programs. When 
they garner share in leading technology industries, even if what 
they did to get them is illegal, they still keep that position. 

But they are not alone in having extensive programs. Look at 
some of the smaller countries: TEIffiS in Finland, a country of 5 
million people, has a program very similar to ATP. It is funded at 
$540 million for a country of 5 million people. In Belgium, a nation 
of 10 million people, they have a consortium for microelectronics re- 
search called IMEC that has budgeted $157 million. The EU has 
a 5-year Framework programme at $22 billion, and they are plan- 
ning to double that. Taiwan, where I just visited as an adviser to 
the prime minister, has the Industrial Research Institute which is 
funded at over $500 million. 

I do not want to abuse my time here, sir, but I think it is very 
important to understand that first we have a sunken cost of $132 
billion in research each year that we need to capitalize on, and 
ATP helps us do that. We need to understand the inherent chal- 
lenges of early-stage finance and the limitations of venture capital, 
both in terms of when they invest in the development cycle and 
what they will invest in. 

In a global economy, as I have pointed out, there are large pro- 
grams, many large well-funded programs, that are successful in 
what they are trying to do. 

We should also keep in mind historically that the U.S. Govern- 
ment has long played a major role in developing the U.S. economy. 
There was a period when we did not. Senator, from about 1792 to 
1798. Since then the government has helped to develop many 
technolgies from interchangeable parts for muskets to the tele- 
graph. I am very proud of what the Congress did in 1842 when it 
gave Samuel Morse a $30,000 grant, a huge sum at that time, to 
prove this complicated idea that you could actually transmit sig- 
nals and messages down electric wires. 

Examples also include aircraft frames, turbines, and radio, nu- 
clear energy, computers, semiconductors, the internet, and the ge- 
nome. 

Senator Coburn. Dr. Wessner, could you try to sum up? 

Dr. Wessner. Thank you, sir, because I am just reaching my 
conclusion. 

I would lastly like to recall that these contributions to our econ- 
omy are central elements in our national security. ATP has made 
significant contributions to our national security, to homeland secu- 
rity. They have developed an x-ray technology that lets you see 
what is inside containers. This is very useful for national security, 
very useful for border security. 

So in sum, sir, I would like to give you the final conclusion from 
the NRC report. I think again you can read this more quickly than 
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I can state. But my point is that we gave a very careful assess- 
ment. 

And I would like to stress, in closing, that someone described me 
as a friendly witness. No sir, we are not, at the Academy, a friendly 
witness. We are an objective witness. After careful analysis, we 
found that the program works and that it achieves its objectives, 
and we would hope that you would continue to fund this well man- 
aged, effective innovation program. 

Thank you, sir. 

Senator Coburn. Thank you. Dr. Wessner. 

I would welcome our other Member, Senator Levin. If you would 
care to make an opening statement now or you would care to defer, 
it is your privilege, sir. 

Senator Levin. Thank you very much, Mr. Chairman, for your 
graciousness. And I think I will make a short opening at the begin- 
ning of my questions. But I would like to submit my entire pre- 
pared statement at this time. 

[The prepared statement of Senator Levin follows:] 

PREPARED OPENING STATEMENT OF SENATOR LEVIN 

America’s tradition of pursing government policies that stimulate economic 
growth, create jobs, and establish self-sufficiency in industries critical to national 
defense dates back to the founding of our Republic. One of our most forward think- 
ing and prolific founding fathers, Alexander Hamilton, not only created the Nation’s 
banking system and laid the foundations for the stock exchange, but he urged a 
Federal role in developing the U.S. economy. 

Alexander Hamilton understood that the wealth and strength of a nation is found- 
ed on its ability to innovate, create and manufacture new and useful products. Al- 
though much has changed since the early days of the Republic, this basic premise 
continues to hold true. 

Today, American manufacturers and businesses face unprecedented foreign com- 
petition. Cheap imports from low-wage nations with weak labor and environmental 
standards put pressure on American manufacturers to shutter their facilities and 
move offshore to remain competitive. According to the Bureau of Labor Statistics, 
nationally we have lost nearly 2.8 million manufacturing jobs since January 2001. 

As a nation, we can’t compete with low wages and weak environmental standards. 
Instead we should compete with cutting edge research and advanced technology. In- 
deed, America’s strength is our intellectual, inventive and creative capacity and our 
ability to constantly innovate through technological developments to increase pro- 
ductivity. Public-private partnerships and collaboration have been a critical part of 
that process, increasing investment in R&D, leveraging dollars and resulting in 
overall benefits to the economy and society. 

Manufacturers’ investment in innovation accounts for almost two-thirds of all pri- 
vate-sector research and development; this investment in turn leads to advances in 
other manufacturing sectors and spillover into non-manufacturing activities in the 
United States. We should be doing all we can to promote programs that help create 
jobs and strengthen the technological innovation of American companies. 

The Advanced Technology Program (ATP) administered by the Department of 
Commerce’s National Institute of Standards and Technology is one of the few Fed- 
eral programs available to help American manufacturers remain competitive in the 
global economy. In particular, ATP helps improve manufacturing efficiency and com- 
petitiveness which lead to growth in productivity. ATP is a bipartisan program that 
was established under the Reagan Administration and funded under President 
George H.W. Bush’s Administration, which recommended significant increases in 
the program in its FY 1993 budget. This high octane economic development engine 
should be supported by Democrats and Republicans alike. 

The ATP was created in part to ensure that the U.S. economy benefited from Fed- 
eral R&D investment through partnerships. ATP bridges the gap between the re- 
search lab and the marketplace by providing cost-share funding in high-risk R&D 
with broad commercial and societal benefits that would probably not be undertaken 
by the private sector because the risk is too great or because rewards to the private 
company would be insufficient to make it worth the investment. 
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Less than 1.5 percent of venture funding is available for proof-of-concept (seed 
funding) and early product development. It has been said that the ATP facilitates 
so called “Valley of Death” projects that private capital markets are unable to fund. 
The Valley of Death is the gap between research and commercialization. As one 
small high-tech start-up participating in the ATP put it: 

“Technology commercialization is HARD. It is also CRITICAL to the growth 
and economic competitiveness of the United States. For those of us out here 
in the trenches, the ATP is a vital source of support. ATP is unique in that 
it specifically focuses on helping bridge the chasm from the lab to the mar- 
ketplace.” 

These investments promote the development of new, innovative products that are 
made and developed in the United States, helping American companies compete 
against their foreign competitors and contribute to the growth of the U.S. economy. 
For example, some of the technologies in which ATP was an early investor include 
DNA diagnostics for medical devices and nanotechnology. 

ATP was also an early investor in nanotechnology research. Nanotechnology has 
the potential to revolutionize almost every aspect of our lives — from smaller and 
faster computers, to miniaturized medical devices, to highly sensitive detectors to 
detect chemical and biological warfare agents. Unlike some of the more traditional 
research investments in nanotechnology — the ATP program is structured to ensure 
significant industry investment — which helps the commercialization of this high risk 
technology. 

An example of this is the work being done with ISSYS, a small company in Ypsi- 
lanti, Michigan, on the development of a portable multidrug infusion system. The 
need for multidrug infusion has not been met by existing infusion pumps because 
of their size, weight, and power consumption. Many diseases require multiple drugs 
to be administered with high accuracy. Cancer treated with chemotherapy and infec- 
tious diseases treated with drug “cocktails” are two examples of disease areas need- 
ing multiple drugs delivered in accord with a strict regimen. Programs like ATP 
that are supporting the commercialization of nanotechnologies will ensure that the 
U.S. retains its position as the world leader in this critical technology area. 

ATP is also playing an important role in developing new energy and power tech- 
nologies that will improve our ability to generate and distribute power efficiently 
and effectively. This is important for our global economic competitiveness and our 
national security systems, and to help reduce our dependence on foreign oil. ATP 
programs invested $225 million (including cost share from industry) between 1997 
and 2003 in advanced power technologies, including fuel cells. An example of this 
is the work of ECD Ovonics in Michigan which, leveraging ATP investment, has de- 
veloped new materials used to store hydrogen to power fuel cells. This research led 
to a $40 million development program with Chevron Texaco for commercialization, 
and to work with the U.S. Army to develop refueling stations for military fuel cell 
vehicles. 

ATP investments in advanced manufacturing technologies are helping companies 
develop and adopt leaner and more efficient manufacturing processes. This improves 
their competitiveness and helps strengthen the U.S. industrial base. As we are see- 
ing in Iraq and Afghanistan, a strong and vital industrial base is necessary for us 
to produce the systems we need for our military, including body armor, combat vehi- 
cles, and electronics for advanced weapons and communications systems. 

Such technological innovations are also critical to homeland security. ATP 
through its own investments and industry cost share has invested over $500 million 
in homeland security technologies like biological sensors. 

A March 1999 study found that future returns from just three of the 50 completed 
ATP projects — improving automobile manufacturing processes, reducing the cost of 
blood and immune cell production, and using a new material for prosthesis de- 
vices — would pay for all projects funded to date by the ATP. According to the De- 
partment of Commerce’s own 2004 report, returns for the American people, as meas- 
ured from 41 of 736 ATP projects (just 6 percent of the portfolio), have exceeded $17 
billion in economic benefits, more than eight times the amount invested by ATP. 
That’s a good return on taxpayer dollars. DOC further reports that resulting tech- 
nologies have been delivered to the nation in new or improved industrial processes, 
products, and services, ranging from more efficient energy sources to improved med- 
ical tests. 

ATP involvement accelerates the development and commercialization of new tech- 
nologies. Time to market was reduced by 1 year in 10 percent of projects; by 2 years 
in 22 percent of projects; and by 3 years in 26 percent of projects. 
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The ATP has received applications from 50 states and made awards to high tech- 
nology businesses in 40 states plus the District of Columbia. Over 170 universities 
have participated in ATP awards. 

One criticism of ATP is that it has funded research projects by large businesses. 
In fact, small businesses are the primary benefactors of the program. About 75 per- 
cent of all ATP projects include a small business with 66 percent (508 of the 768) 
being led by or involving only a small business. But some amounts of large company 
joint venture ATP participation has been found to be beneficial. The National Acad- 
emy of Sciences’ National Research Council found that the diversity of the ATP 
awards, involving both large and small companies, is an important feature of the 
program, and should be retained. It found that large companies bring unique re- 
sources and capabilities to the development of new technologies and can be valuable 
partners for technologically innovative small companies new to the market. ATP re- 
quires large businesses to contribute more matching funds to ATP projects: At least 
60 percent of project costs. 

The ATP has been extensively studied and time and again it has been found to 
be effective. 0MB and the National Academies have rated the ATP proposal review 
process very highly. One of the most comprehensive evaluations of the program was 
undertaken in 2001 by the National Academy of Sciences’ National Research Coun- 
cil. Dr. Wessner, the editor of that report is testifying today. As I’m sure Dr. 
Wessner will elaborate in his testimony, the National Academy found the ATP to 
be an effective Federal partnership program that is meeting broad national needs. 
The Academy recommended that the program receive additional funding so that it 
can further achieve its goals. Mr. Chairman, I ask unanimous consent to insert a 
summary of the Academy’s findings in the hearing record. 

The Biotechnology Industry Organization (BIO), the Industrial Research Institute, 
the Alliance for Science and Technology Research in America, the American Chem- 
ical Society, the U.S. Advanced Ceramics Association, the National Center for Man- 
ufacturing Sciences, the Optical Society of America and many other organizations 
have also expressed support for ATP. The Senate recently confirmed its support for 
ATP on a budget resolution amendment I authored with Senator DeWine. 

I ask unanimous consent to include in the hearing record a number of letters of 
support for the ATP and other important Federal research and development pro- 
grams.'^ 

Senator Coburn. That is great, Senator Levin. Ms. Nazzaro. 

TESTIMONY OF ROBIN NAZZARO ,2 DIRECTOR, NATURAL RE- 
SOURCES AND ENVIRONMENT TEAM, GOVERNMENT AC- 
COUNTABILITY OFFICE 

Ms. Nazzaro. Thank you, Mr. Chairman, and Members of the 
Subcommittee. I am pleased to be here today to discuss our work 
on the Advanced Technology Program. 

ATP was established in 1988 to support research that accelerates 
development of high-risk technologies with the potential for broad- 
based economic benefits for the Nation. Between 1990 and Sep- 
tember 2004, ATP funded 768 projects at a cost of about $2.3 bil- 
lion in Federal matching funds. Under the provisions of the Omni- 
bus Trade and Competitiveness Act, which established ATP, pro- 
gram administrators at the National Institute of Standards and 
Technology are to ensure that they are not funding existing or 
planned research that would be conducted in the same time period 
in the absence of ATP financial assistance. 

Research can provide both private benefits which accrue to the 
owners of the research results and societal benefits which accrue 
to society as a whole. In some instances, the private sector does not 
fund research that would be beneficial to society because doing so 
might not provide an adequate return on the firm’s investment. 


^The letters appear in the Appendix on page 183. 

2 The prepared statement of Ms. Nazzaro appears in the Appendix on page 52. 
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To address this situation, the Federal Government supports re- 
search that has very broad societal benefits. However, there is a 
continuing debate over whether the private sector has sufficient in- 
centives to undertake research on high-risk, high payoff, emerging 
and enabling technologies without government support such as 
ATP. 

In this context, we determined whether, in the past, ATP had 
funded projects with research goals that were similar to projects 
funded by the private sector and, if identified, whether ATP’s 
award selection process ensures that such research would not be 
funded in the future. 

Our objective was not to provide an evaluation of the quality of 
the research funded by ATP or the private sector nor the impact 
these projects may or may not have had on their respective indus- 
tries. 

To determine whether ATP had funded projects similar to the 
private sector projects, we chose 3 of the first 38 completed 
projects, each representing a different technology sector: Com- 
puters, electronics, and biotechnology. These 3 sectors represented 
26 of the 38, or 68 percent of the ATP projects completed by 1999. 
We found that the 3 completed ATP funded projects addressed re- 
search goals that were similar to those already funded by the pri- 
vate sector. These projects included an online handwriting recogni- 
tion system, a system to increase the capacity of existing fiber optic 
cables for the telecommunication industry and a process for turning 
collagen into fibers for human prostheses. 

In the case of the handwriting recognition project, ATP provided 
$1.2 million to develop a system to recognize cursive handwriting 
for pen-based computer input, in other words, without a keyboard. 

We identified several private firms that were conducting similar 
research on handwriting recognition at approximately the same 
time the ATP project was funded. In fact, in this line of research, 
which began in the late 1950s, we identified multiple patents as 
early as 5 years prior to the start of the ATP project in the field 
of handwriting recognition. We found similar results on the other 
two projects. 

Two inherent factors in ATP’s award selection process, the need 
to guard against conflicts of interest and the need to protect propri- 
etary information, make it unlikely that ATP can avoid funding re- 
search already being pursued by the private sector in the same 
time period. These factors, which have not changed since 1990, 
make it difficult for ATP project reviewers to identify whether simi- 
lar efforts are being funded in the private sector. 

For example, to guard against conflicts of interest, the program 
uses technical experts who are not directly involved with the pro- 
posed research. Their acquaintance with ongoing research is fur- 
ther limited by the private sector’s practice of not disclosing its re- 
search efforts or results so as to guard proprietary information. 

In conclusion, we recognize the valid need to guard against con- 
flicts of interest and to protect proprietary information. However, 
as a result, it may be impossible for the program to ensure that 
it is consistently not funding existing or planned research that 
would be conducted in the same time period in the absence of ATP 
financial assistance. 
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Mr. Chairman, that concludes my prepared statement. I would 
be happy to respond to any questions that you or Members of Sub- 
committee may have. 

Senator Coburn. Thank you. 

Senator Lieberman, while you were out I offered an opportunity 
for you to make an opening statement now or when you start your 
questions, whichever would be your prerogative. 

Senator Carper. And I spoke on your behalf 

Senator Lieberman. You gave an opening statement on my be- 
half? Very nice of you. 

I will wait until the last witness and then, if it is all right, make 
an opening statement. Thank you. 

Senator Coburn. Absolutely. Mr. Riedl. 

TESTIMONY OF BRIAN RIEDL, i GROVER M. H ERMANN FELLOW 

FOR FEDERAL BUDGETARY AFFAIRS, THE HERITAGE FOUN- 
DATION 

Mr. Riedl. Thank you, Mr. Chairman, and the Subcommittee for 
scheduling this hearing. 

My name is Brian Riedl. I am the Grover M. Hermann Fellow 
for Federal Budgetary Affairs at the Heritage Foundation. The 
views expressed in this testimony are my own and should not be 
construed as representing any official position of the Heritage 
Foundation. 

Federal spending now tops $22,000 per household, the highest 
inflation-adjusted total since World War II, and $5,000 per house- 
hold more than the government spent in 2001. Budget deficits top- 
ping $400 billion are forecast as far as the eye can see. Given the 
Nation’s budgetary challenges, the Advanced Technology Program 
remains one of the least justifiable programs. The President and 
the House of Representatives both support ATP’s abolition. The 
Senate should join them. 

ATP was created in 1988 supposedly to provide research and de- 
velopment grants to help small businesses develop profitable tech- 
nologies. In reality, ATP funnels taxpayer dollars to Fortune 500 
companies. Between 1990 and 2004, 35 percent of all ATP funding 
was granted to Fortune 500 companies. For example, IBM has re- 
ceived $127 million in ATP subsidies. General Electric has received 
$91 million. General Motors has received $79 million. Motorola and 
3M have each received $44 million. All in all, 39 Fortune 500 com- 
panies have received a total of $732 million from the Federal Gov- 
ernment in ATP subsidies. 

Mr. Chairman, this is the kind of spending that outrages tax- 
payers. At a time when the Federal budget is deep in the red, there 
is no justification for taxing waitresses in Tulsa or cashiers in Flint 
in order to lavish hundreds of millions of dollars on Fortune 500 
companies. 

ATP defenders will say that these subsidies generate greater 
technological innovation. They can point to many technologies on 
the market that ATP has funded. Of course ATP has funded some 
successful products. But the key question is whether the market 


^The prepared statement of Mr. Riedl appears in the Appendix on page 104. 
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would have produced those products even without ATP. Both eco- 
nomic theory and practice say yes. 

ATP does not fund basic science research like the National 
Science Foundation. Rather it funds the commercialization of re- 
search so the businesses can profit from it. Basic economic theory 
tells us that profit seeking firms have every incentive to fund prof- 
itable R&D themselves. If these projects are as promising as 
claimed, the company should have no problem convincing their 
shareholders to fund the projects or tapping into the $150 billion 
that private investors annually spend on R&D. 

The 39 Fortune 500 companies that have received ATP funds re- 
port a combined $1.4 trillion in annual company revenues. To sug- 
gest that these companies cannot afford their own R&D is baseless. 
Yes, ATP has funded HDTV and fiat-panel televisions. But if they 
had not, a line of investors and businesses surely would have. 

The economic argument that ATP merely subsidizes existing 
R&D is also backed up by surveys of ATP participants themselves. 
Although the program is supposed to be a financier of last resort 
for companies that have exhausted all other options, a survey 
shows that two-thirds of ATP applicants never bothered to seek 
any private funding before going to the government. 

And among the near winners who had claimed that ATP was 
their final hope, half of them found private funding after they were 
rejected. Among the other half who did not find private funding, 
most never bothered to apply for private funding. They just contin- 
ued to play the ATP lottery year-to-year. 

Not only is ATP a giveaway for wealthy companies that merely 
subsidizes existing research, but evidence shows that Uncle Sam is 
a poor investor. Only one out of three ATP projects ever brings a 
new product to the markets. One reason for this abysmal track 
record, as stated by the last presenter, is that ATP officials try to 
minimize conflicts of interest by seeking outside grant reviewers 
with little or no knowledge of the technology markets. And even if 
they sought market knowledge, most private companies in these 
markets conceal their research agendas, leaving ATP officials to 
guess where the market openings are. This blindness results in 
grants for projects that either duplicate existing private research or 
are doomed to fail. 

Consequently, ATP has granted money for technologies that had 
already been developed, patented and marketed by other compa- 
nies years earlier. It has granted money to projects that have been 
discredited by their entire industry. 

Simply put, investors have better knowledge and more skill in- 
vesting than government officials. 

In conclusion, technological advancement is vitally important to 
this Nation’s economy. Yet when the governments try to pick the 
winners and losers by micromanaging technological innovation, the 
results will always disappoint. ATP subsidizes Fortune 500 compa- 
nies that already have the money and incentive to fund their own 
profitable projects. And too many companies see ATP as little more 
than an ATM for the projects they would never spend their own 
money on. 



14 


With Federal spending at $22,000 per household and growing by 
$1,000 per household each year, ATP should be the first target law- 
makers seek for savings. 

I will be happy to answer any questions. 

Senator Coburn. Thank you. We will start the questioning with 
our Ranking Member, Senator Carper. 

Senator Carper. Dr. Wessner, I just want to ask you to respond 
just briefly to some of the comments we have just heard. 

Dr. Wessner. Thank you. I appreciate the opportunity. 

I have gone over Mr. Riedl’s commentary on the ATP program, 
and I apologize, but I think some of the references there illustrate 
some of the basic flaws in the analysis. 

First, when he refers to basic economic theory, and while eco- 
nomic theory is a really interesting thing, it does not have a lot to 
do with how the economy actually operates, particularly in the 
murky stage of early-stage finance. 

The idea that the references to profitable R&D, which strike me 
as something like an oxymoron, decrying that the ATP program 
only succeeds one of three times. The last time I checked, a .333 
batting average was a pretty good batting average. 

In the venture capital community, if you succeed 2 out of 20 
times, you are doing well. I am not sure that ATP actually succeeds 
3 out of 10 times. But the point is that for early-stage finance, that 
is a very high success rate. 

I would also point out, just for a second, if we want to talk about 
economics, that there is a serious selection bias here. Two-thirds of 
the program goes to small firms and all the Heritage criticism is 
devoted to the funds going to large firms. It misses the very concep- 
tion of the ATP program, which was to do both grants to small 
firms with promising technologies and to encourage cooperation be- 
tween large and small companies, which is good for the large com- 
panies and good for the small companies. It is a way of strength- 
ening the industrial fabric in the United States on which our na- 
tional security ultimately rests. 

There are also claims that have been made, for example, regard- 
ing the Communications Intelligence Corporation on the cursive 
handwriting recognition. There is a factual error there. That pro- 
gram ultimately succeeded. That ATP program has been adopted 
by the Palm Operating System. 

But fundamentally, what it is important not to leave out, when 
we talk about how well ATP does, is a point of comparison. What 
are we comparing it to? We are working in an area where we want 
to convert research investments into products that help us in our 
lives, that enhance our national security, improve the ability of the 
government to complete its missions. ATP does all that. It does it 
arguably better and with more careful assessment than any other 
program we have. 

I am very pleased to see this status report here. Have you ever 
tried to get a status report on the success of projects from the De- 
partment of Energy or the Department of Defense? We have been 
mandated by you, the Congress, to look at the SBIR program. We 
cannot get this kind of data on the SBIR program. 

What this data underscores is in fact one of the strengths of 
ATP. It has one of the most rigorous and effective assessment pro- 
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grams in the U.S. Government. Its assessment program is consid- 
ered a best practice model around the world. 

Let me just close by saying, that 2 hours ago I left a Dutch dele- 
gation at the Academies. They were here to talk with us about how 
they might adopt SBIR and expressed their interest in ATP. The 
rest of the world thinks that what America is doing with these pro- 
grams is really quite interesting and quite effective. 

Senator Carper. Dr. Wessner, how do you measure success at 
ATP? 

Dr. Wessner. That is a good question, sir. One of the ways you 
can measure success is in commercial sales. You can also measure 
it in terms of patent licensing. You can also measure it in whether 
you have effective spillovers. 

Let me give you a quick case. In the early 1990s there was an 
investment with Bell Labs in extreme ultraviolet lithography. That 
did not seem to work out for about 3 years. And then Intel decided 
that was actually the technology it would need to maintain its glob- 
al position, and it began a consortium based on this technology 
with Sandia National Laboratories. I think that illustrates the 
synergies that this program can develop — and particularly, for ena- 
bling technologies. 

I would consider a metric of success for the funding of 
Afametrics, which may revolutionize how we develop drugs. As 
many of you know, we have a serious problem in drug development 
in this country. 

I would also suggest that the investments in microturbines and 
fuel cells, where ATP has more success than much larger programs 
elsewhere, are a way of enhancing our energy security and a way 
of enhancing our national security by being able to provide secure 
and portable energy supplies. 

There are a whole range of things, but let me just close on one 
of the most amazing set of investments, in nanotechnologies, in 
Zyvex in Dallas. I was inspired by a speaker who described how 
important ATP was to developing his nanocompany. And that is ex- 
actly were ATP should be in that early phase, where it is hard for 
the companies to obtain funding and too risky for venture capital- 
ists to invest. 

And I would want to stress here that this is not an either/or. We 
need the basic research. We need the applied research that often 
comes out of the military. We need other programs like SBIR that 
are designed to encourage this. And we need ATP. Asking which 
one is more important is like asking which rung in the ladder do 
you think you need. You need all the rungs on the ladder. That is 
how you get there. You may be able to skip one, but it gets very 
hard to skip two. 

Senator Carper. Dr. Wessner, my staff tells me that the percent- 
age of funds that are invested in larger firms, you mentioned GE, 
General Motors, and others, that the percentage of funds going to 
large firms like that has declined over time and that now the per- 
centage of monies that are going to smaller firms is closer to 75 or 
80 percent. Is there any truth to that or is that a bold-faced lie? 

Dr. Wessner. No, that is absolutely true, sir. It has gone up 
sharply. In fact, to illustrate the power of the synergies of working 
with large and small firms, thanks to an ATP grant GE and a 
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small company were able to develop a new digitalized breast imag- 
ing that has offered serious health advantages to women and to the 
society. 

Very briefly, the advantages are not that it is better than what 
a very experienced doctor can do, but it is better than what the av- 
erage doctor can do. Because it is digitalized, you can get a second 
opinion easily. It has fewer false positives, which has enormous 
consequences. My understanding is that biopsies are running in the 
$20,000 to $25,000 range. So not having false positives that result 
in unnecessary biopsies, not to mention the terror imposed on the 
woman, is a major gain for society. 

And because it was with GE, imagine if the company just did it 
alone. Here is Joe New Company 

Senator Carper. Dr. Wessner, I am going to ask you to wrap up. 

Dr. Wessner. My point is that by working with GE they were 
able to extend this across the Nation, lower the cost, and get it out 
to areas where there is less coverage. So it is working with poorer 
people and more geographically thinly populated areas. It is a posi- 
tive sum that was only possible by the double combination. 

Senator Carper. Thank you. Thanks, Mr. Chairman. 

Senator Coburn. I would just make one comment. GE has digi- 
talized every area, every radiographic area, that they work in. This 
had no impact in terms of doing it. Because GE would have spent 
the money to do that anyway. 

The cost on a biopsy is about $4,000, not $25,000, and digitaliza- 
tion has been taking place in the radiographic industry for years 
with the plan that everything would become digitalized. And the 
fact that a company that spends $5 billion a year on its research 
needs ATP to accomplish this one goal is a way of supporting a 
small company, I would grant you. But in an environment when we 
have $622 billion that we are going to spend, over $22,000 per 
man, woman and child, that we do not have the money for today, 
to say that ATP is responsible for that and extrapolate it out is not 
good science. 

That is an anecdotal observation that would not have happened 
had you all not been there. And I would tell you that in every other 
area of contrast radiography, CTs and everything else have been 
completely digitized. That would have happened anyway. They 
were going to spend the money on it because they had to spend the 
money on it to get it to the point it needed to be so that all x-ray 
technology can be digitalized. And it is all digitalized today. 

They all read them from home at night or in the afternoon, sip- 
ping tea. 

Senator Lieberman, welcome. 

OPENING STATEMENT OF SENATOR LIEBERMAN 

Senator Lieberman. Thanks, Mr. Chairman, thanks for your 
kindness to me. We ought to get together and sip a little tea. 

Senator Coburn. And read an x-ray or two. 

Senator Lieberman. Yes, read an x-ray or two. 

I thank you for calling the hearing. I am an unabashed admirer 
of ATP, so I disagree with respect. 

There is no question about the overall point that Mr. Riedl spoke 
to, which is that we have an imbalance between our revenues and 
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expenditures in the Federal Government that we have to work to 
close. But I would not start here. 

Last time I looked, I think this was about $140 million or $150 
million a year out of a budget now of $2.7 trillion. And I think this 
has a multiplier effect that is powerful for our economy. 

It is also in the best tradition of public/private partnerships that 
have made the United States the world’s technological and eco- 
nomic leader. We have to continue to do that if we want to stay 
there. 

Our history actually shows that from the telegraph to the Inter- 
net, from the automobile to the airplane, it really was Federal sup- 
port and investment that helped bring those products to the mar- 
ket to spur commercial and consumer demand, and to create jobs. 

One that I love is that when Samuel Morse sat in the Supreme 
Court building in 1844 and typed out that history telegraph mes- 
sage, “what hath God wrought,” he was doing it in a demonstration 
fully funded by Congress, less of a multiplier effect, I guess, in dol- 
lars, than what we are talking about. This is the spirit of ATP, 
which has nurtured the kind of breakthroughs that Dr. Wessner 
has talked about. 

The numbers I have say that overall ATP has invested $2 billion 
in nearly 800 projects, helping attract another $2.1 billion in pri- 
vate investment. And that the current portfolio of ATP investments 
is expected to return at least $17 billion in benefits to the Amer- 
ican people, which I think is a really good return. 

Senator Carper made the point that I wanted to make, that the 
vast majority of these ATP investments go to small businesses. 
There was some earlier inclination to try to involve some of the 
larger businesses cited and to try to push them into collaboration 
with the smaller businesses. But that has receded now. 

To me, ATP is a success story that has earned our continued sup- 
port, particularly at a time when we are facing competition from 
abroad exactly in this area. I cite a few countries, Sweden, Finland, 
Israel, Japan, and South Korea each spend more on research and 
development as a share of GDP than we do in the United States. 
That is a bad sign. 

Also, today foreign-owned companies and foreign-born inventors 
account for nearly half of U.S. patents. Of the 25 most competitive 
IT companies, only 6 are based in the United States and 14 are 
based in Asia. By the end of 2005, there are going to be 59 ad- 
vanced semiconductor fabrication plants worldwide and this indus- 
try, which was essentially founded in the United States, only 16 of 
those 59 are going to be based in the United States. 

So we have got a problem here and I think de-funding ATP 
would really be withdrawing from the field and could mean losing 
economy changing new technologies to foreign countries, to inno- 
vators who could not finance their research and development ef- 
forts here. 

The point is this, that we are living in an age of technological 
advances at very high speed. The famous fable aside, in this case, 
in this global economy and technological world, the hare will al- 
ways beat the tortoise. There are a lot of hares waiting to get out 
of their cages but cannot unless they receive the kind of support 
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that ATP gives that they cannot find from the venture capital com- 
munity. 

So I really hope that we will sustain this organization. 

I want to just ask one question and not indulge on your goodness 
in giving me time. Dr. Wessner, I wanted to ask you this, if you 
could think about and speak to what other public or private enti- 
ties would be available to accomplish the goals of ATP if ATP were 
eliminated? In other words what are we at risk of losing? 

Dr. Wessner. Thank you, Senator. At least, I think I thank you. 
That is actually an interesting, which is to say a difficult, question. 
I think the short answer is twofold. First, there is not a program 
like ATP. You would open up a gap in the innovation system. And 
I think over time there would be a loss for the U.S. economy and 
for our competitiveness. 

I am not, by any means sir, predicting immediate disaster. That 
would be unwarranted. I would argue that there would be things 
that we would lose out on having funded here and lose out on hav- 
ing those benefits and technological 

Senator Lieberman. If I hear you correctly now and in your ear- 
lier statement, what we are talking about here is that point be- 
tween the breakthrough discovery and commercialization where 
venture capital often does not tread, which I have heard some peo- 
ple refer to as the valley of death in the innovation cycle. 

Dr. Wessner. Yes, absolutely. And the program is uniquely de- 
signed to address the valley of death. And something that has im- 
pressed us in the course of the Academy study, and we do not say 
this about some of the other programs we are looking at, is that 
the program has developed exceptional expertise in evaluating 
these applications and in processing them. I think that some of the 
difficulties they have about knowing whether or not other research 
is going on is to be expected. That is true in the venture commu- 
nity. That is true in the banking community, as well. This is not 
unusual. 

But they do have valuable institutional knowledge. There is a 
substantial body of work about the importance of what economists 
call intermediating institutions. Between the very powerful, and 
very positive, private marketplace, which characterizes the U.S. 
economy, and the sunken costs of the basic research that we carry 
out, these intermediate institutions act as a bridge across that val- 
ley of death. In short, ATP would be very hard to replace. The ac- 
cumulated expertise is invaluable. 

And could I suggest, sir, that there are two areas of application. 
One is on the health care side where, when we held our first meet- 
ing on this, senior officials from the National Cancer Institute ar- 
gued that this program could be very helpful to them in capital- 
izing on the increased R&D investments. And second, we are com- 
ing out shortly with a report that stresses the importance of public/ 
private partnerships in developing new technologies against ter- 
rorism. The fight against terrorism is exactly the type of area 
where you want to bring new technologies and products forward 
faster than the market alone would. 

The fact that ATP already has helped in some important areas 
of the war on terror is important. 
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Senator Lieberman. Thank you. Thanks, doctor. Thanks, Mr. 
Chairman. 

Senator Coburn. Senator Lieherman, I would like to just put in 
the record to note that according to the testimony we had, the writ- 
ten testimony, the U.S. market share of high technology from 1988 
until 2004 has remained exactly the same at 31 percent. I, like you, 
worry about how we are going to compete in terms of globalization. 
But I am also concerned that the economics of production favor pro- 
duction outside of this country. And to the point that we are facing 
today, it is starting to support the research outside of this country. 
I think that is a valid point. 

I wanted to clarify that the hearing today is not about whether 
research is important to us. The hearing is about are there other 
ways to do it? And are there other ways to spend the money? And 
contrast that with the effectiveness of what we are seeing today 
versus maybe spending that money in other areas. 

We spend a ton of money through NIH and through the National 
Science Institute. It is not a question of decreasing the research. 
It is a question of is there a better way to spend the money to get 
more bang for the buck? 

Senator Lieberman. Mr. Chairman, I would just respond briefly. 
Of course, I believe that this ATP does fill a space in the apparatus 
uniquely that is not filled elsewhere. But I agree with the two 
other things you said very strongly, which is the real danger now, 
you are right, we have lost jobs for economic factors, basically that 
people can get things done more cheaply elsewhere in the world. 

The danger now is exactly what you have said, which is that we 
will lose the research and development base of our country abroad, 
including the research and development base of American compa- 
nies, because now they can find highly skilled, highly educated 
workers abroad who are still working for much less in comparable 
here. That means we are going to lose the engine of innovation 
which drives the new jobs. 

The other thing, and this is a topic for a separate conversation 
between me and you, but particularly in the health area I have 
been talking to people and trying to put some legislation together, 
and I am going to give you a call and sit down with you, aimed 
at — I am focusing now for a moment on NIH — on making sure that 
we get more from what we are investing there and that we develop 
systems for — and here is the big term that I have learned in the 
last few months, Mr. Chairman — translational research. 

That we figure out a way, as I put it in lay language, to take 
the clinical breakthroughs and move them more rapidly to the bed- 
side, to the doctor’s office, to the medicine chest. That is a real gap 
that is not being filled now. Thank you. 

Senator Coburn. Senator Levin. 

OPENING STATEMETN OF SENATOR LEVIN 

Senator Levin. Thank you, Mr. Chairman. I was really intrigued, 
Mr. Riedl, when you made reference to that waitress in Flint. I 
have talked to a lot of waitresses in Flint. And they are deeply con- 
cerned about 2.7 million lost manufacturing jobs in this country the 
last 4 years. And ATP is one of the few programs that we have 
which is directly aimed at trying to see if we cannot have some fii- 
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ture manufacturing jobs in America where the government is ac- 
tively involved in supporting technologies which might otherwise 
not be supported. 

Would they otherwise be supported? That is the question that we 
can argue over. But we have got some good evidence on that from 
people who are right there on the front line. We have a lot of folks 
who have received these grants who have said that but for these 
ATP grants, they would not have produced the technology. That is 
pretty direct evidence. There are a lot of people who have said this. 

Here is a letter from RAPT Industries in Freeport, Pennsyl- 
vania. ^ “My company, RAPT Industries, was the recipient of an 
ATP award from 2003 to 2005. RAPT is developing a revolutionary 
new process for manufacturing precision optics. ATP has played a 
critical role in our success, funding our technology development 
when NO OTHER source of commercial funding was available.” 

So it is kind of easy for us to talk about theory, and we do a lot 
of that. But there are an awful lot of folks out there who have re- 
ceived these grant awards, who have said to us that but for that 
support they would not have been successful and that they could 
not have produced what they produced. And what they produced 
has been a success. 

So I am willing to put an awful lot of stock in those stories that 
we receive from people who have actually been recipients of these 
grants. 

I am also deeply concerned about what other countries do, com- 
pared to what we do. I am talking here governments. We look at 
worldwide government funding for nanotechnology. Japan spent 
$800 million in 2003 compared to our $774 million. We used to 
spend more than Japan on nanotechnology, by the way. They have 
now caught us and overtaken us. 

I think that there is a philosophical issue here in terms of the 
role of government. You just described this as government picking 
winners and losers and that is it for you. We pick winners and los- 
ers all the time. 

In energy we pick winners and losers. We decide we are going 
to provide this kind of tax credit for this kind of energy develop- 
ment or oil exploration. We are going to supply this kind of tax 
credit for biotechnology. We are going to produce Ethanol. I guess 
the credits for Ethanol is picking a winner or loser is it not? 

Mr. Riedl. Not one that we support, either. 

Senator Levin. That is exactly my point, that there is a real phil- 
osophical issue here. This is not just a question of whether or not 
this specific program has produced more than it has invested, and 
I will get to those numbers in a minute. 

But there is a philosophical issue, a philosophical backdrop to 
your testimony here, which has to do with the role of government 
and just how active do we want our government to be in terms of 
giving incentives or in terms of giving the kind of support that 
some public policy would suggest we ought to support, whether it 
is energy production or whether it is putting in energy saving win- 
dows. We decided at one point we were going to give tax credits 


1 Letter from Dr. Peter Fiske, Co-founder — RAFT Industries, Inc., dated May 20, 2005, to Sen- 
ators Carper and Levin appears in the Appendix on page 183. 
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to people who will put in energy saving windows as a matter of 
public policy. There were a lot of folks who asked what are we 
doing that for? They said let the market decide that. 

We decided well, if you let the market decide that we may stay 
on the same course that we are on relative to energy, which is a 
huge deficit in energy. So we cannot just let the market work its 
will or else we are not going to do things that we need to do in 
energy conservation. We are not going to do the things we need to 
do in global warming. Do we want to let the market do what it 
wants to do in global warming? Or is there a public policy that is 
telling us hey, if you keep going down that road, we are going to 
pay a heavy price. You cannot just let the market play out and 
have its will on everything. 

That does not mean you do not believe in the market. It just 
means you believe in a government role as well. I think there is 
a difference here, a significant difference in emphasis, that lies be- 
hind your testimony than lies behind Dr. Wessner’s testimony. 

Now in terms of what this produces, what does the ATP program 
produce? There is a report from the Department of Commerce. It 
is the 2004 Report on Economic Progress measuring the impact of 
the Advanced Technology Program. It is a Department of Com- 
merce publication. It says the following: Returns for the American 
people as measured from 41 of the 736 projects, which is just 6 per- 
cent of the portfolio, have exceeded $17 billion in economic benefits, 
more than eight times the amount invested by ATP. Resulting 
technologies have been delivered to the Nation in new or improved 
industrial processes, products and services ranging from more effi- 
cient energy sources to improved medical tests. 

I would ask that the report be made part of the record. It may 
have already been made part of the record. ^ 

Senator Coburn. Without objection. 

Senator Levin, are you aware of how that $17 billion number 
came into existence? 

Senator Levin. No. 

Senator Coburn. Could we have somebody address that, if any- 
body would care to on the panel, the $17 billion number? 

Let me give you the history of how it came about. There was a 
survey asked by ATP about what do you think the economic benefit 
is of your product. There was no scientific study. There was no ac- 
tual econometric measurement. That was a response to a question 
by ATP of what they thought it was. And it has no connection with 
what reality is because it is a thought. It is not a measured re- 
sponse, in terms of economic return. 

So we really do not know whether that is a true statement or 
not. It may actually be much higher. But it was on the basis of a 
poll of the ATP awardees that asked them about the potential 
value of that project. 

Senator Levin. I think it could be off but it could be accurate. 
It is the best evidence we have, though. 

Senator Coburn. But from a scientific standpoint. Senator Levin, 
if we are going to make decisions based on total guesses on the 


^The 2004 Report on Economic Progress submitted for the Record appears in the Appendix 
on page 125. 
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ATP, and that is what we are doing. There is no econometric model 
that is measuring that. 

And maybe that is something we should do if we continue ATP. 

The other thing that I was thinking as you were talking is why 
should the government not have some ownership associated with 
this investment, as we do in a lot of drugs and a lot of other money 
that we fund? Why should the government not get a return for that 
risk? Should there not be a way of sourcing the Federal Govern- 
ment back for the risk that it is taking, the American taxpayers, 
in terms of putting this money out there? 

This may very well be a true number. I just would tell you, as 
looking at how the number came about, it is hard to know whether 
it is a real number or not. 

Senator Levin. Let me just read something, and I thank you for 
that. I think it is the best evidence we have, even though it comes 
from the people who received the grants, is what you are saying, 
the people who actually were in the program. I will give them a 
presumption that they are telling the truth. I think there is the 
presumption that they are giving us on an honest estimate. 

But in any event, let me just read this one piece and I think my 
time is up. ATP’s Economic Assessment Office, according to this 
piece of paper I am reading, and maybe we can ask the witnesses 
if they know if this is accurate. But ATP’s Economic Assessment 
Office uses statistical analyses, case studies, economic and econo- 
metric analyses, surveys and other methodological approaches to 
measure program effectiveness and return to taxpayers. 

I do not know where this came from so I cannot tell you that this 
is accurate but I have to assume it is, since my staff gave it to me. 
They always give me accurate information. 

But according to this, the Economic Assessment Office at ATP 
does use econometric analyses. So we ought to find out just what 
is the basis from them, since they are not witnesses here today — 
I wish they were. But in any event, perhaps we could ask them 
what is the basis for that $17 billion. 

Senator Coburn. Absolutely. That is a fair question. And actu- 
ally, without objection, we will ask that question of ATP. 

Senator Levin. That would be great. Thank you, Mr. Chairman, 
my time is up. 

Senator Coburn. You are welcome to continue if you would like. 

Dr. Wessner. Senator, may I make a small comment? 

Senator Coburn. Absolutely. Please do. 

Dr. Wessner. Let we say that I admire your skepticism about 
numbers in the evaluation process. I think that is often most war- 
ranted, and I mean that very sincerely. 

What I can affirm is that our multi-hundred page study here 
looked very carefully at their assessment program. And our view, 
a view of independent economists not attached to the program, is 
that it had the greatest rigor of any comparable program. 

Senator Coburn. In the Federal Government? 

Dr. Wessner. Yes, in the Federal Government. Now that may 
not be a high standard. 

Senator Coburn. That is a low standard. I want you to know, 
that is a very low standard. 
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Dr. Wessner. Given, Senator, that I said compared to what? 
They do way better than most. 

Second, could I draw to your attention, and I do not want to read 
it at any length, but on page 208 we have a paper by two inde- 
pendent economists. They concluded — and I will be very brief here. 
Senator — that ATP is selecting projects and firms that have greater 
potential for increasing the circulation of new knowledge and for 
having the business connection necessary to realize economic bene- 
fits from its activities. 

I am jumping ahead. We provide evidence that the investment 
community values the ATP award. Among firms that seek addi- 
tional funding, we find that ATP award winners are more success- 
ful than non-winners. 

Now I am very attached to the private markets, and what I find 
validating for ATP is that after they have made those awards the 
companies get this halo effect, this certification effect, where the 
private investors are attracted to them. 

Senator Coburn. So what you are saying, there is value to rec- 
ognition by ATP through a grant that allows them better access to 
more marketable money? 

Dr. Wessner. It generates better recognition — because the in- 
vestment community recognizes that the selection criteria are 
tough. Remember only 12 percent of the firms are selected. In that 
regard, that is why I reject this idea that ATP is corporate welfare. 
Corporate welfare, as you know, is an entitlement for a class of 
people or firms — but only 12 percent of the ATP applicants receive 
an award. Thus an ATP award is much more akin to getting a 
scholarship. It is very competitive and you have to be good to get 
it. 

Senator Coburn. Thank you. Ms. Nazzaro. 

Ms. Nazzaro. If I may comment, one comment that Dr. Wessner 
made was that the individuals that were doing these reviews were 
not affiliated with the Department of Commerce. You may want to 
include that as a question for the agency because we have found 
in the past that these reviewers are, in fact, paid by the Depart- 
ment of Commerce to do these studies. While we did not review the 
2004 study, we have reviewed earlier studies and have found that 
some of the economic assumptions that are made have been flawed. 

For example, in one case they had cited an example with the 
printed wiring board effort that they had funded. And they had ex- 
trapolated that that influence went to the entire industry. Well, the 
industry at the time had 800 members. So there was no way that 
one project had that kind of an impact across the whole industry, 
if you will. 

Granted, what they had done was good research. However, you 
could not make that kind of an extrapolation. 

Senator Coburn. I think it is also fair to note, if you are a stock- 
holder in a major corporation, you are thrilled to get an ATP grant. 
That is return on your money. There is no investment, there is no 
risk on this money. 

I want to ask a question if I might. One of my concerns with ATP 
is this is supposedly grant money from people who cannot get 
money somewhere else. Is that true? Is that the way the project is 
supposed to be set up? In other words, the design behind the ATP 
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program was that this was going to supply a need where capital 
was not available for research in the private sector? 

Ms. Nazzaro. Just one caveat to that is that it would not be 
funding existing or planned research that would be conducted in 
the same time period, in the absence of ATP. 

Senator Coburn. So there is two points. First, the GAO study 
found that 63 percent of the people who actually got grants never 
asked for money and never applied for any money in the private 
sector? Is that a true statement? 

Ms. Nazzaro. Correct. That was in our 1995 study. 

Senator Coburn. And second, there was no knowledge on the 
part of ATP in granting that whether or not there was any other 
research being done in any of the private sector. Is that a true 
statement, as well? 

Ms. Nazzaro. At that time, yes. 

Senator Coburn. Is that not true now? Has ATP responded to 
that criticism? Do we see something different now? 

Ms. Nazzaro. Yes, in response to that report that we did in 1995, 
when we did bring them to task, if you will, on the fact that they 
were not aware of whether these individuals had applied for fund- 
ing other places, they do now ask that question of whether they 
have. As to what weight that bears in their final determination, I 
am not aware of. 

Senator Coburn. My staff tells me having not sought private 
funding today is still not a disqualifying factor. 

Ms. Nazzaro. As I said, I do not know what the implication is 
but they do ask the question. 

Senator Coburn. Mr. Riedl, did you want to say something? 

Mr. Riedl. On that, that is exactly the same research that we 
have seen, that 63 percent never sought private funding that apply, 
65 percent of the winners never sought private funding, and 56 
percent of the near-winners never sought private funding. 

Again, of those who said it was the financier of last resort who 
just came up short, half of them miraculously found funding after 
they were rejected. Most of the other half who did not never looked. 
These are people who never looked before and never looked after. 
They decided that we are only going to keep playing the ATP lot- 
tery year after year. 

So for the most part, the argument that we need these grants be- 
cause we need this technology to keep up with other countries is 
tough to sustain when data shows that those who do not get the 
grants or who look are able to get funding elsewhere. What that 
shows is that we are subsidizing existing research. Despite the best 
of intentions to create new research, it does not do that. 

The point also that I want to make on that is, in terms of the 
broad argument about how we need to fund technology and how 
important it is, total Federal R&D spending, according to 0MB, 
has jumped 53 percent since 2001 to $122 billion. ATP represents 
0.1 percent of the Federal R&D budget. 

So we are not talking about totally taking five steps back, in 
terms of Federal R&D spending. We are talking about the small 
sliver, 0.1 percent, that really has an abysmal track record. And 
that could be shifted into, say, the NSF or the NIH or something 
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else where you do not see evidence that you merely he subsidizing 
existing research. 

The final quick point that I wanted to make was regarding the 
argument that ATP creates $17 billion in new value, again that 
$17 billion number is only relevant if you assume that none of 
those ATP grants would have been funded by the private sector. If 
ATP projects create $17 billion but you assume that most of those 
projects would have been funded anyway and then you would say 
the private sector would have created $17 billion in new growth for 
the economy other than the ATP. 

And if it is important to have the ATP’s endorsement in order 
to attract more seed funding, I would be happy to have ATP slap 
a sticker on certain projects, saying the Department of Commerce 
thinks this is a really good project so other investors go for it, with- 
out necessarily giving them the grant. If the grant is not the best 
thing, just the endorsement, give them the endorsement. 

Senator Coburn. Let us go back to those people who do not get 
grants from ATP. What percentage of the people who do not get 
grants, who apply for grants but do not get grants from ATP, get 
funded in the private sector? 

Mr. Riedl. The only surveys that I have seen only look at the 
near-winners, the people who came up really close. Half of them 
find private funding after, is the number that I have seen. And 
again, of the half that do not, that overwhelmingly correlates with 
those who do not look for private sector funding afterwards. So 
among those who look, the vast majority find private sector fund- 
ing. 

Ms. Nazzaro. Our numbers support that statement, that half of 
the near-winners continued their projects without relying on ATP 
funding. 

Another important note is that seven applicants in our study 
turned down offers from the private sector because they could not 
reach an acceptable funding arrangement. 

Senator Coburn. In other words, they went ahead anyhow but 
they did want the private sector because they did want to give as 
much of a percentage of ownership should they have been success- 
ful? Was that the implication? 

Ms. Nazzaro. That was why they came to ATP, because they had 
actually sought funding but turned down offers from the private 
sector. 

Senator Coburn. Dr. Wessner if, in fact, the Federal Govern- 
ment continues ATP and does it in a way to where the Federal 
Government gets a revenue stream off of it, and if your numbers 
are correct, in 2 or 3 years we can fund more than $125 million 
just off the earnings potential of the research that you are doing. 
Why would we not want to make this an investment, rather than 
a grant, and saying that we are a participant, just like our univer- 
sities are on drugs and other patents and other patents. Why 
would we not want to turn ATP into that type of a vehicle? 

And if it is really getting a $17.2 billion return on $125 million, 
why would we not want to grow that in a private investment mech- 
anism and endow it? 

On the things we fail to do in Washington is to endow things. 
That is why we are struggling with Social Security. We are strug- 
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gling with Medicare. We are struggling with them because we do 
not save in advance. We do not prepare for the future. 

I would just love your thoughts. What about sharing — what is 
wrong with the American taxpayer, who has now put over $2 bil- 
lion into this program and gotten what looks like a 900 percent re- 
turn to the economy over the life of the program, what would be 
wrong with the American taxpayer sharing enough to continue the 
program? 

Dr. Wessner. Thank you, sir. We have analyzed a number of 
other programs and are in regular dialogue and consultation with 
countries around the world who have similar programs. The Euro- 
pean Union, because of their suspicion of the private sector, is al- 
ways trying to have recoupment mechanisms. And Senator, there 
is strong support from lawyers and accountants to do recoupment 
programs from which they would profit. 

The difficulty is that it is very hard to calculate the exact benefit 
that results from any particular grant or any particular project. 
CEOs generally think it is thanks to their leadership and vision 
that the company goes on to have major sales. The technical staff 
generally think it is because of their competence and skill. The gov- 
ernment likes to claim 

Senator Coburn. But that is an intermediary problem. That is 
negotiated every day in the private sector. I am going to give you 
$50,000, here is what I am going to expect if we are successful and 
we have a patentable and marketable product. Here is the share 
of the return and here is the share of the gross sales. 

Dr. Wessner. We think the government already is a partner. 
The government is a partner because if the company is in existence 
and paying salaries, we tax them. If the company is making any 
money, we tax that revenue, as we should. It is a much cleaner, 
simpler system. 

Senator Coburn. Except for everybody that is not getting an 
ATP grant, they are not getting the money and they are getting 
taxed as well. 

Dr. Wessner. It is a competitive program, sir. Not everybody 
gets a scholarship 

Second, if I could go on, we are drawing our figures from this 
analysis, which is publicly available both on the Web and we have 
them here. Some of these claims, leaving aside my GAO colleague, 
I do not recognize where they come from. I would like to say, in 
a friendly but very sincere fashion, that this is a serious topic. And 
making unsubstantiated claims that the private sector would have 
done it anyhow, as one of my colleagues here has done, is simply 
not acceptable analysis. There is no documentation for that. Our 
figures do not support that assertion of the same high number of 
companies being funded anyhow. 

Senator Coburn. What do your numbers show, in terms of 

Dr. Wessner. Seventy percent do not go on at all or at the same 
level. 

Senator Coburn. How many go on, at any level, that are turned 
down by ATP? 

Dr. Wessner. Thirty percent, if my memory serves me. 

Senator Coburn. At any level? 
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Dr. Wessner. At any level. But I would be happy to get back to 
you for that and we can actually document this for the record in 
a serious fashion. 

Senator Coburn. So 70 percent of the people who do not get an 
ATP scholarship do not continue their research? 

Dr. Wessner. In that area, of course. 

Senator Coburn. In that area. Nobody picks it up, it does not 
continue. And you all have looked at the studies to see whether 
that has been picked up by the private sector? 

Dr. Wessner. My understanding is that the figure is 70 percent 
either not at all or not at the same level. These things are meas- 
ured in some nuance. Senator. It is difficult to ascertain if it is a 
major program or does the company just have one engineer work- 
ing on it? 

One of the points I raised earlier, and as Senator Lieberman sug- 
gested, is that it is important to dialogue about this because the 
hurdle rates and the development process within a firm are hard 
to understand. Asking a CEO what he is going to do in a particular 
area, how many resources he is going to put in, what is the poten- 
tial, can management justify the investment compared to alter- 
natives, is difficult. In the best of circumstances, this is all very 
tough to learn even without any Federal award at all. 

What we have seen is that the Federal awards have a catalytic 
effect that tend to provide internal justification for investment and 
also attract external investment. The awards help get something 
done. 

Occasionally, a researcher can come in from the R&D unit and 
say “look, we just got this ATP award and we want to go forward 
with this.” And the CEO who had turned down the project earlier 
will say “OK, let’s go for it. There may be a market there, and this 
will provide me with some reputational benefits which will enable 
us to go ahead.” 

And again may I put a nuance here? We are not saying that the 
early-stage financing system in the United States would not work 
in the absence of ATP. That would be absurd. But to say that this 
program adds value is true. Also, what I liked was your opening 
remark, “Is it a quality program?” Yes, it is both internationally 
and nationally, a quality program. In fact, it is one of the best we 
have. 

Is there an impact? Yes, and they have made a real deter- 
mined — not perfect but determined — effort to measure it much bet- 
ter than others. 

Is there a significant benefit? Yes. Have I associated the Acad- 
emies’ work with that $17 billion return number? No, sir, I have 
not. 

Senator Coburn. The problem is, and maybe it is our measure- 
ment. But if you use the PART program that we are trying to use 
in the Federal Government to assess whether programs are suc- 
cessful, whether they have a measurable end point, can you men- 
tion the benefit, do you have defined objectives, it does not meet 
it. And that is why it was on the President’s list. 

And the whole purpose of this hearing is to see is if that is legiti- 
mate? 
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Let me just stop for a minute and I want to raise the level. Every 
man, woman, and child in this country right now owes $36,000 on 
the Federal Government’s deht. The interest on that is $1,800 this 
year. Plus we are going to add another $2,200 associated with the 
budget deficit, the real budget deficit, this year. Plus we are going 
to add another $1,100 in Social Security increased liability and we 
are going to add another $2,600 this year to everybody in this 
country in terms of Medicare unfunded liability. 

So we are either going to start making the tough decisions about 
what is good for us and what is not and it may be that ATP is a 
great program. But should we be spending the money on that great 
program when there are other great programs that we could? And 
can we continue to spend $125 million or $135 million on ATP pro- 
gram when what it is doing is actually cutting the legs out from 
underneath the children of the next two generations because they 
are going to have a reduced standard of living? 

So it is not about priorities. That is where we have to get to. And 
I recognize and I will tell you, and I think your performance and 
your demonstration and defense — I read your testimony, it is an 
excellent defense of this program. And I think it is done very well. 
But I also think that there are still questions that need to be an- 
swered with this program. 

One of them is on this slide. The fact that there is no status on 
programs from 1992, 1994, 1997. The fact that we do not know the 
status? That is a problem in itself 

But again, let us look at it macro. What should we do as a coun- 
try, now that we are almost $8 trillion in debt on the regular budg- 
et, that we have $43 trillion in unfunded liabilities for the baby 
boomers, that is my generation and maybe a few of you sitting out 
there. And we are going to ask our children to pay for it. So it be- 
comes a matter of priority. 

Which is the best programs that we should fund? What should 
we fund first, second, third, fourth, and fifth. 

If we were in surplus, I probably would not even be having this 
hearing because there has been marked improvement in the ATP 
program since 1996. They have markedly changed. They have 
changed the amount of money that goes to small businesses and 
taken a lot more away from it. 

But that is not what the issue is. The issue is: Can we afford to 
have a program when we are having the kind of deficit and prob- 
lems that we are having today? And is it, looking at the next two 
generations, in the priorities of where we should be spending our 
time today? 

I believe that we can justify most of the Federal Government pro- 
grams that we have. I think most of them are well-intentioned, 
well-meaning, the thought behind them, the people that created 
them, the people that work in them are well-intentioned. But when 
we put all that together and then we say our grandkids are not 
going to be able to afford a college education — it is not going to 
matter whether we send technology oversees. We are not even 
going to be able to afford a college education for them as we strug- 
gle with this unfunded liability that is in front of us. 

So we need to have a critical look, not emotional but a critical 
look, at everything this government is doing and say which is the 
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most important priorities. And if you look at the numbers that are 
happening to us and what the projections are, we cannot grow our 
way out of it. 

So the answer then has to come back as where do we squeeze? 
Now we could do what I have offered several times. Let us cut ev- 
erything 5 percent. We could make it. If we cut ATP 5 percent and 
everybody else 5 percent, we could make it. We know we could do 
that. But we do not have the political will to do that. We do not 
have the political will to send that signal to the international fi- 
nancial markets, which is our biggest problem today. 

So I do not want you to take this personally, I do not want the 
people at ATP to take this personally. This is about a good, open, 
honest evaluation, not is it good. But is it good enough to continue 
spending the money on that is going to undercut the future of this 
country? Because this money is borrowed. On 30-year notes we are 
paying 4 percent on it and it is going to be compounded every year. 
So by the time you really start compounding, you get a lot of 
money. 

What is our obligation? Is it to make the easy choices now and 
fund ATP so that everybody at home is happy and the people who 
run ATP are happy? Or is it to make the hard long-term choices 
that are best for this countp^? How do we best secure the future? 

And that is my consideration. Ms. Nazzaro. 

Ms. Nazzaro. Dr. Wessner points to some of the studies that we 
have done. In our most recent study, where we looked at three 
projects, our concern was to look at whether this is research that 
the private sector would have funded. In those three projects we 
identified that they were funding projects that were similar to the 
same goals that the private sector would have funded. 

In their agency comments, the Department of Commerce came 
back and said if we had looked at all 199 projects that were funded 
at that time, we would have reached the same conclusion. So they 
concurred that we were not trying to pick examples hopefully to 
make a best case. 

Senator Coburn. So Department of Commerce readily admits 
that they are funding things that would have been funded in the 
private sector? 

Ms. Nazzaro. In the comments to our report, first they said, we 
presumably picked these three projects with the intent to make a 
particular point. We said we did not. We picked three technology 
areas. Those technology areas represented almost 70 percent of the 
projects that had been funded by the program. 

Initially, we intended to look at nine case studies. But when we 
realized how labor-intensive it was to do an adequate and thorough 
job, we cut that back to three to make sure that we were really re- 
searching to make sure that these projects were, in fact, similar re- 
search goals. 

And when they came back and commented on our report, they 
said if we had looked at all 199 projects that they had funded to 
date, we would have reached that same conclusion. 

Senator Coburn. Thank you. Mr. Riedl, I think it is really fair 
for you to be able to reference your numbers. I think Dr. Wessner 
makes a great point. And I think if you do not have those numbers, 
you need to 
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Mr. Riedl. I do. 

Senator Coburn. I will give you an opportunity to do that. 

Mr. Riedl. The numbers that I had mentioned, specifically that 
the idea that ATP individuals who are near-winners could find 
funding in the private sector, is not just an economic theory that 
Heritage has pulled out of a hat. This is based off a survey through 
a GAO report that was reported in January 1996, which I believe 
you have with you today. 

Senator Coburn. It is a part of the record. 

Mr. Riedl. That shows specifically that half of those near-win- 
ners reported finding private sector funding later. And the vast 
majority of those who did not find private sector funding later re- 
ported in a survey to GAO that they did not seek private sector 
funding. 

And furthermore, there is actually a report that was written by 
the National Institute of Science and Technology within the De- 
partment of Commerce in December 1996 that admitted that ATP 
funds projects which are the most profitable, the most ready for 
commercial success, and therefore the ones that the private sector 
would have most incentive to fund anyway. This is the Department 
of Commerce, itself, saying this. 

So I think there is some degree of universal agreement in most 
areas that there is a real economic issue regarding whether or not 
we are subsidizing existing research that would have happened 
anyway, or new research. The evidence seems to show whether it 
is a PART, GAO, or a Heritage’s analysis, that we are probably 
subsidizing existing research. 

And while I do not want to quibble with the studies that are 
being quoted by Mr. Wessner, he did mention that one of the stud- 
ies was led by Intel, a gentleman from Intel. And it is not uncom- 
mon for studies headed by the industry receiving government stud- 
ies to show that the subsidies lead to the public good. That is not 
uncommon to see those conclusions. 

Senator Coburn. My observation is that there has been some 
pretty good improvement through what Dr. Wessner has given for- 
ward in his testimony versus 1996. And so I think our dependence 
is on that. 

But I think there is a valid point in what you say, Mr. Riedl be- 
cause if, in fact, they want us to believe the $17 billion survey but 
do not want us to believe the survey that says the opposite of that, 
you cannot use those same methods and come down. 

I think it is important for us to have a healthy look at it. 

Dr. Wessner, I am going to give you an opportunity to comment 
again because I want to make sure you get into the record what 
you want and rebut what you heard from Mr. Riedl if you want to. 

Dr. Wessner. Thank you. There are two things. 

One is there are perhaps three brief elements. The first I would 
like to express quietly a level of outrage about the most recent com- 
ment about Gordon Moore. As I am sure you know, sir, Gordon 
Moore was a founder of Intel. At the time of this study I think he 
was worth many billions of dollars. He is retired after a long, 
arducous, and successful career. Many of the medical instruments 
that you use are as a result of the advances that have gone on 
through Moore’s Law. He is a distinguished person and has chaired 
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the CalTech Board. The idea that we need to raise an ad hominem 
comment about a man who gave freely of his time in his retirement 
years to lead the study is repugnant in the extreme. 

I would point out that Gordon Moore was initially skeptical 
about ATP. He was skeptical that we should intervene in the mar- 
ket at all, although he recognized that the semiconductor consor- 
tium Sematech was not a bad idea, (and a successful one I would 
note). Indeed, Gordon Moore likes to point out that in the case of 
Sematech, the entire Federal contribution over the 9 years is paid 
back quarterly by Intel in its taxes. 

His observation illustrates the point that as these partnerships 
to go forward, the gains that you are looking for are realized. Let 
me also stress that I am very sensitive to the deficit. My son is 19. 
He is taking economics, bless him. And he came down and said 
“dad, how are we going to pay back this deficit?” And I said “who 
is we, paleface? This problem is yours.” 

Senator Coburn. But that is a very important point and let me 
make it just for a second. Never in the history of our country have 
we had one generation of Americans about to leave the next gen- 
eration in such sad shape. Our heritage defies that we would do 
that. 

And so when we come to a $125 million program that may have 
some good, is there another $125 million program that has more 
good? 

In other words, it is not about everything is bad. It is not. Unfor- 
tunately, my frustration is we cannot get enough people up here 
thinking that way because we are not going to trip the deficit until 
we have a financial disaster in the international financial commu- 
nity. I am pretty well down to that. But that does not mean we 
should not try. 

And so the improvements that have been made in the ATP pro- 
gram are great, and it is not that we should not do research, and 
it is not that there are not good outcomes from some of that re- 
search. And it is not that everything that ATP does is wrong or less 
than perfect. It may be that 80 percent of it is right. 

The question is can we afford to continue to spend $125 million 
in this area, versus should we cut $125 million out of Medicaid? Or 
should we reverse the Stark Law so that we allow medical tech- 
nology to flow from hospitals to doctors so we decrease medical 
error? 

The point is that we have to make those decisions and it is in- 
cumbent upon us to start doing it pretty quickly or we are all going 
to be in a pretty good sized jam. 

I think your testimony, and your defense of where they are, dem- 
onstrates very well that there has been major improvements since 
1996. Your testimony said that. 

Some of the anecdotal — and I have trouble with anecdotal stories 
because they do not mean anything scientifically, they do not mean 
anything mathematically, and they do not mean anything economi- 
cally because they are an observation of what happened but do not 
compare what happened to what might have happened by chance 
or in the private sector. 

So when we try to make decisions for investment of Federal tax- 
payer money based on anecdotal observation, it is not good science. 
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And we have enough junk science up here, and we certainly should 
not he using it with economics. We cannot make that decision. 

An example being digitalization of mammography. I will guar- 
antee you as much as I take my next breath that that would have 
happened in the private sector without the first penny from ATP 
because it was happening everywhere and it had to happen if GE 
wanted to sell mammography units. They would have funded it had 
you not funded it. 

Dr. Wessner. Senator, first off, we at the Academies do not fund 
it. And I would be the last 

Senator Coburn. I mean ATP. 

Dr. Wessner. I will be the first person to defer to your expertise 
in medical technologies. But I can give you, at the close of this ses- 
sion, the page number where Dr. Griffiths from GE made that ar- 
gument. 

Senator Coburn. If you are from the private sector, you would 
make the argument every time. You do not have to spend the 
money. You did not have to spend the money, the Federal Govern- 
ment spent the money for you. 

Dr. Wessner. Actually, they had to spend a lot more money. 

Senator Coburn. But they got Federal Government money. If I 
got a grant and I said hey, I am successful with it, you guys did 
it. 

Dr. Wessner. I can only tell you what the interview found. We 
did not conduct the interview — it was done by a group of Harvard 
researchers — who found that GE basically did not think that there 
was any money in this technology, in this mammography system. 
And they were not willing to do it. The ATP award let the advo- 
cates of this new technology win the day inside. 

While recognizing the reality of a % 2.1 trillion budget I would 
suggest that the real challenge, if I may venture. Senator, is that 
the difficult choice is to keep ATP. 

Senator Coburn. Maybe. 

Dr. Wessner. Because the tides are against it politically. The 
difficult choice is to say that the ATP program is actually seed 
corn. And the seed corn is what we need to plant. 

Senator Coburn. That is a great point. 

Dr. Wessner. Will every one sprout? No. But the chance that 
only a third of them do is, in fact, a very positive statement. And 
they can pay back — that is my point about Intel. They can pay 
back over time to help reduce this deficit. 

Senator Coburn. But we have to qualify. A third do but many 
of those would have anyway, according to the research that has 
been done about ATP. Because the private sector would have fund- 
ed about half of them. And half of those who did not get funded 
would have gone on anyway. 

Dr. Wessner. I am running a team right now of about 16 econo- 
mists for an evaluation that the Congress mandated of the SBIR 
program. The hardest thing in the world. Senator, is to figure out 
what would have happened anyhow. The question is analogous to 
“If you had not married your wife, who would you have married?” 
“If you had not gotten the scholarship, would you have gone to col- 
lege?” “Where would you have gone to college?” “What would have 
happened?” Those are darn difficult questions. 
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Senator Coburn. Those are great points. But we do have testi- 
mony and there is a GAO report that says here is the facts. 

There has been improvement and I think you make a great point. 
The hard thing maybe to continue to fund ATP in those choices. 
You may be right. But what we have to do is really know what the 
return on it is. 

The other thing that I am a little bit disappointed in is every- 
body pays taxes that does research in this country that makes any 
income. They pay it on their employees and everything else. And 
I believe I see a way to fund ATP in the future. And it ought to 
be endowed by the money, the seed money it puts in. And it ought 
to get a return for the taxpayers. 

And if we continue ATP, then we ought to be figuring out a way 
for ATP to become self-funded. And if ATP is great, then let us self- 
fund it and let us let it grow. And let us let it get bigger. 

Dr. Wessner. We would be happy to study that for you, sir. 

Senator Coburn. I do not want to study it. I understand one 
thing. Greed conquers all technological difficulties. It does. The de- 
sire to advance, to advance oneself, will cause people to take risks 
that they would not have otherwise if they perceive that risk ben- 
efit reward. That is true in government. That is true in the private 
sector. That is true of senators and congressmen. 

And so my hope is that bringing this information forward 
today — actually, I have gotten a good viewpoint. I am enlightened 
somewhat. And I am much more positive about what the changes 
from ATP than what we saw in 1996. But that does not mean it 
should not change some more. 

The question is if it stays around, how should we modify it? How 
should we make it more effective? How should we make sure that 
the American taxpayers, if they are going to fund $125 million a 
year, of which half of it is probably going to have been funded any- 
way, how do they get a return on that? And how do we build an 
endowment so that endowment pays for that? Ms. Nazzaro. 

Ms. Nazzaro. Just in summary, we would like to also reiterate 
your opening remarks, that ATP has certainly been associated with 
a number of successes. And we have given them credit for encour- 
aging joint ventures and economic growth. 

However, the discussion cannot be just about benefits. It has to 
be about costs. 

And you talked about whether there are other ways to do it? If 
half the projects now are going to small businesses, there is the $1 
billion Small Business Innovation Research Program, as well as the 
Small Business Technology Transfer Program. We have seen that 
some of the applicants not only receive ATP funding but then go 
and get SBIR awards, as well. 

Senator Coburn. They know where the money is. 

Ms. Nazzaro. They know where the money is, that is right. 

Also, your discussion of payback. It is our understanding that the 
Act originally had a payback provision. And each year GAO does 
a report called the Budget Options Report. We have continuously 
made that recommendation, that for research, there should be a 
payback, particularly if it is large companies that are getting the 
money. There has to be a way that you can assess what the impact 
has been, whether you have been allowed to commercialize a prod- 
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uct and you are now having sales or revenues, you should he able 
to pay back some of that money and make it a self-sustaining pro- 
gram. 

Senator Coburn. Dr. Wessner. 

Dr. Wessner. Just a quick observation. We are looking at the 
SBIR Program, as I mentioned. 

One of the things that is important to keep in mind — we refer 
to the active venture capital community, but the fall from $100 bil- 
lion available in the year 2000 to just over $20 billion now illus- 
trates some of the unpredictability of venture markets. Both SBIR 
and ATP saw very rapid rise in applicants as the private sector — 
if you take a glance at this — as they moved farther upstream and 
away from this valley of death area. 

The last point, if I may, simply, for the record, sir, because it is 
an important one, regarding the statement by my colleague, whom 
I respect immensely, that NIST agreed with them on their 2000 re- 
port is not accurate. I would simply like to enter into the record 
the director at that time writing that he “disagreed with both the 
methodology and the conclusions reached in this report.” He writes 
that the implied argument in the GAO study is that the Federal 
Government should not fund research that shares the same overall 
goal as research funded outside the government. By that criterion, 
he notes, we would shut down Federal research on cures for cancer 
and AIDS and a host of other diseases, wireless communications, 
computing technologies and manufacturing. The fundamental error 
in this report is its failure to understand and address the central 
aspect 

Senator Coburn. You can submit that for the record and we will 
include it in the record. ^ 

Dr. Wessner. My point is that they took strong issue. 

Senator Coburn. We will also include the letter from Appendix 
V, comments from the Department of Commerce, page 35, which 
states the opposite of that or a different opinion than that.^ 

Let me also make one last note, and then we will adjourn the 
meeting. And I want to thank each of you for spending the time 
to come here. Thank you for your efforts and your service to the 
country and your efforts to make sure we make good decisions. 

When you talked about the other countries that, in fact, fund re- 
search through their government, what is their percentage deficit 
to their GDP? 

Dr. Wessner. Most of them just export to us, sir. They are doing 
pretty well. 

Senator Coburn. That is right. Most of them have surpluses. 
They do not have deficits. A big point. 

We could be in a lot of different things if we did not have a def- 
icit, if we were in surplus. I might even earmark something for the 
first time in my political career, which I have never done. 

But the fact is we are not there. So in comparison, you to com- 
pare what our investment is as a percentage of our GDP and what 
our deficit is as a percentage of GDP as to whether or not — the fact 


^The GAO report appears in the Appendix on page 66. 
2 The letter appears in the Appendix on page 99. 
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is, we cannot grow out of it. It would be wonderful if we could, but 
we cannot. 

I would still make one point, we still have the highest growth in 
productivity of anybody in the world. We have the highest growth 
in productivity. And that is because we are working hard at doing 

it. And most of that is coming out of the private sector. It is not 
coming out of government-funded research. It is coming out of inno- 
vation and that concept I talked about before, greed conquers 
technologic difficulties. And we need to recognize that. 

I want to thank each of you for being here. A copy of the record 
will be made available to you. A copy of the record will stay open 
for any additional comments from any other Members of the Com- 
mittee. 

Thank you very much and the hearing is adjourned. 

[Whereupon, at 4:09 p.m., the Subcommittee was adjourned.] 
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Mr. Chairman, 

I am Charles Wessner, and I direct the program on technology, innovation and 
entrepreneurship at The National Academies. While the views I offer the Committee today 
are my own, my testimony also incorporates the specific recommendations contained in the 
consensus report of the National Academies that reviewed the ATP program. 

Today, I would like to talk briefly about what ATP is and what it is not and why it is 
important to continue supporting this innovative and effective program. In the course of 
our discussion, we can also explore some myths and realities about innovation in the United 
States. 

ATP’s mission is to accelerate the development of innovative technologies for broad 
national benefit through parmerships with the private sector. A recent National Academies 
assessment of ATP, under the leadership of Gordon Moore of Intel, found that ATP is 
meeting its mission goals.' In short, the program contributes to our nation’s innovation, 
economic growth, and national security. 

Why is the program needed? Very simply because even though we recognize that 
innovative technologies have the potential to bring enormous benefits to society as a whole, 
private investors often can not adequately support their development because profits are 
often too uncertain or too distant. 

How does ATP work? The program seeks promising new projects that 1) must be 
proposed by industry; 2) must be directed and carried out by industry; and 3) must be 
funded by industry on a cost-shared basis. The awards often serve a catalytic function, often 
creating new parmerships between large and small companies and universities. The bulk of 
ATP awards, nearly 70 percent, go to small businesses that drive innovation, employment, 
and growth in the U.S. economy. 

How well does it work? An impartial Academy assessment found ATP to be a proven 
program, with a positive track record. In fact, ATP has demonstrated over 1 5 years that is 
works weU. It achieves its goals of stimulating risky, new, high-payoff technology 
development, by funding small companies and bringing together universities, small firms, 
and large companies. We can say that with confidence because the ATP program is quite 
Hkely the most intensively smdied, rigorously scrutinized and carefully assessed U.S. 
technology program of the past 50 years. By itself, the National Academies review of ATP 
consumed two years, three major meetings, two major reports and numerous detailed 
smdies. The process involved a 15-person steering committee, including leading economists 
and wide consultations with the venmte community, major corporations, small companies, 
and government officials. And as with all Academy smdies, the findings were then subject 
to a second independent review as per standard Academy procedure. This rigorous, 
impartial analysis is the basis for our positive view of the program. 


’ National Research Council, The yidvanced Techmh^ Pro^am, Assessing Outcomes^ C. Wessner, ed. Washington, 
D.C.: National Academy Press, 2001. 
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Our work on innovation also brought to l^t a set of common myths about markets and the 
innovation process that must be overcome if we are to successfully meet intense global 
competition, especially in high-tech manufacturing, and, by doing so, maintain the economic 
strength that sustains our national security. 

The National Academies finds that ATP Works 

Based on this thorough National Academies’ assessment, we can report to you that 
the ATP is definitively meeting its Congressional mandate to provide cost-shared 
funding to industry to accelerate the development and broad dissemination of 
challenging, high-risk technologies that promise broad-based economic benefits for 
the nation. 

The Academies complimented ATP for the rigor and quality of the assessment program, 
suggesting that other programs might see it as a best practice model. The ATP assessment 
program includes 

• A rigorous selection process, where companies must prove a need for government 
support, as well as demonstrate the technical and commercial merit of their project; 

• Real time project monitoring, with a demonsttated willingness to stop funding for 
projects that ate not performing; and 

• Follow-up evaluations to ensiure that funded projects are achieving technical, 
commercial, and social goals called for by ATT. 

The good news is that ATP investments are already yielding high remms. Innovative 
technologies for knee repair and early breast cancer detection, for example, not only return 
our citizens to happier, more productive lives but lower medical costs for all as well. ATP 
has also helped to fund work to support U.S. manufacturing, such as on printed wiring 
boards, and supported promising technologies such as fuel cells and DNA diagnostics that 
will contribute to our nation’s growth and security. 

In short, ATP is a specific example of what works wett in the general area of government- 
industry-univetsity technology patmerships. The ATP program is a rather unique part of the 
overall complex of technology programs that the U.S. Government supports. It is 
exceptional in several ways, including its intelligent design and its remarkably thorough 
assessment program. But keep in mind that AIT is part of a family of long-standing U.S. 
programs, whether it is military research at ONR, new concepts funded by DARPA, or the 
two-phase SBIR program that helps bring new technologies to the war-fighter. In all these 
cases, the government is really helping to plant long-term technology seeds where private 
markets hesitate to go or to address acute public needs. Some of those technology seeds will 
sprout, others will not. But the planting, as an activity on the whole, must go forward if long- 
term economic gains ate to be effectively harvested. 

Let me talk for a moment about a few myths about the U.S. innovation system. 

The Myth of Perfect Markets 

The first major myth is that “if it is a good idea, the matket will fund it.” In reality, market 
participants nearly always have less than perfect knowledge, especially about innovative new 
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ideas. This “asymmetric information,” as economists call it, makes it difficult for small firms 
to obtain funding to develop new ideas for the market. The reality facing firms in the early 
stages of their development is what Congressman Vernon Ehlers referred to as “the Valley 
of Death” between federal funding for basic research that creates new ideas and closer-to- 
market product development that can be attractive to venture capitalists and other private 
investors. 


The Reality; The Valley of Death 

Early-Stage Funding Gap 


Capital to Develop 
Ideas to Innovation 




Product 

Development 

& 

Innovation 


The Valley of Death results ftom the different levels of information that exists between an 
entrepreneur and potential investors and partners. Lacking full appreciation of the 
technology, investors hesitate to provide the funds that would permit the entrepreneur to 
demonstrate the concept. These funding gaps matter because equity-financed small 
businesses are one of the most effective mechanisms for capitalizing on new ideas and 
brining them to market. Small businesses are also a leading source of growth and 
employment in the United States 

The Myth of the Venture Capital Solution 

While almost every small businessperson who has brought an innovative product to market 
can tell you about his or her experience with the Valley of Death, many in the policy world 
still believe that because we have a robust venture capital market, VC finance alone is the 
solution to the many challenges of early-stage finance. This is not the case. For a variety of 
reasons, private capital markets tend to both over- and under-invest in new technologies. 
Venture funding can also be quite unpredictable. You recall that venture funding soared to 
some $100 billion in 2000 and then, after a dramatic fell, stabilized just over $20 billion last 
year. 
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Why does this happen? Because early-stage technology capital markets are prone to 
numerous imperfections including herd behardor among investors, information asymmetries, 
institutional imperatives focused on the later stages of technology development, and early 
exit— all of which were amply on display dmmg the collapse of the dot-com technology 
bubble. As a result, some new technology domains may get too much attention from private 
investors while other promising areas may get comparatively little. After ah, the goal of 
venture capitalists is not to develop the U.S. economy with long-term investments but to 
obtain a timely and significant return for the funds’ investors. The key point is that the large 
U.S. venture capital market is not focused on early-stage firms with promising but unproven 
technologies. Reflecting this reality, the amount of eatly-stage financing available from 
venture capitalists is quite small, around f 346 million of the |20.9 biUion noted earlier. 


Large U.S. Venture Capital Market is 
Not Focused on Early-Stage Firms 

Breakdown of U.S, Venture Capital by Stage of 
Development-2004 



45.42% 

(Expansion) 


□ Startup/Seed ■ Early Stage □ Bcpanston □ Later Stage I 


These problems are especially severe for promising but risky new technical approaches. 
These approaches often require intensive coUaborarion across multiple technical disciplines, 
requiring the coordination among companies and, increasingly, universities. Even witii 
promising technologies, it is sometimes hard for company managers to see a clear, 
reasonably short-term path to the necessary return on their investment. In those cases, 
public-private partnerships like ATP can play an essential, catalytic role in helping to foster 
technical innovation to the point where private capital markets can sustain further 
development. 

Reflecting these realities, influential venture capitalists have spoken positively about the 
program. For example, as you can see, David Morgenthaler, a past President of the National 
Venture Capital Association, has affirmed the value of the program. He emphasizes that its 
focus is not on the same financial space as venture funds and welcomes these types of 
leveraged public-private investments in potential platform technologies of the future. 
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“[TIk- ATF] is .in excellent program for developing enabling, or platform, 
technologies, which can have broad appUcations but are long-term, risky- 
iincstincnts. Venture capitalists are.not going to fond these opportunities, because 
they will feel that they are at too early a stage, of maturity. Government can and 
: should fund tliese technologies. In fact, it should do more than it is doing.” 

David Morgenthaler 

Worgenihalet Ventures' ... 


The Myth of Crowding Out 

Still, some ask, “Wouldn’t private capital support an ATP project anyhow?” The short 
answer is “usually not.” Why? Because it is too risky, the technology requires competencies 
not controlled by one firm, and/or the cost is simply too high. ATP addresses these factors. 
Our research supports this view. Looking at the 1998 ATP applicants one year after the 
funding decisions, NRC researchers found that most of the non-winners (70%) had not 
proceeded with their proposed R&D project’ Of those that did, most were working at a 
smaller scale than initially proposed. This result suggests that firms are not seeking ATP 
funding for projects they would conduct anyway — ATP is not “crowding out” the market 
Crowding out is theoretically possible but our research from some of the country’s leading 
economists, Stanford’s Paul David and Berkeley’s Bronwyn Hall, found that evidence for 
crowding out was problematic at best. The NRC research acmaUy shows that'* ATP award 
winners were more likely to actually receive additional funding from private sources. This 
suggests that the ATP award creates a "halo effect" for recipients. 

The Myth about Awards for Large Companies 

A persistent myth is that ATP pays businesses to perform activities they would naturally do 
anyway. The reality is that new ideas, by definition, lack champions. ITiis means that 
researchers within larger corporate organizations often have difficulty getting funding within 
their company to develop innovative but risky new products. An ATP award can help 
validate and provide seed funding for these ideas, when they promise widespread societal 
benefits. While over sixty-eight percent of ATP awards go to small businesses that ate 
seeking to commercialize innovative ideas, government awards are also sometimes necessary 
to attract internal funding within larger firms. 

For example, between 1995 and 2000, ATP co-funded a joint venture project with General 
Electric Corporate R&D and EG&G Reticon on a cost share basis to develop a low-cost 
manufacturing process for digital mammography and radiography systems.’ "The project 
lowered the cost of mammograms and, because they were digitized, permitted easier second 
opinions and reduced false positives with the expensive and nerve-racking biopsies. As costs 


^ See National Research Council, The Advanced Technohp Prt^tam: Asseesin^ Outcomes, opMt, p- 66. 

’ Maryann P. Feldman and MaryeUen R. KeBey. “Leveta^g Research and Development: The Impact of the 
Advanced Technology Program,” in National Research Council, The Advanced Techno/egi Png-am, Assessing 
Outcomes, op. cit. 

4 Ibid. 

5 See National Research Council, The Advanced Technology Pngram Assessing Outcomes, op.cit, pp. 90 and 96, 
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for equipment fell, distribution to rural areas rose, with the attendant benefits. ATP’s 
investment in this technology resulted in a productive alliance between large and small firms. 
This successful joint venture illustrates both the positive synergies resulting from small and 
large firm cooperation and the reality that there is a valley of death for new technologies, 
even in the largest companies.'* 

The Myth about Picking Winners and Losers 


As we have seen, public-private partnerships like ATP — involving cooperative research and 
development activities among industry, government laboratories, and universities — can play 
an instrumental role in accelerating the development of new technologies from idea to 
market’ Yet many believe that the government should not be in the business of supporting 
new technologies, claiming that the government should not be picking winners and losers. 
This easy statement is also a myth, one that ignores U.S. history and current practice. This 
myth appears in several different forms, often mixed together. The claim is that— 

• The government cannot successfully make judgments about new firms or technologies, 
or 

• The government should not substitute its judgment for that of the market, or 

• Government intervention in the market is unwarranted and therefore constitutes 
corporate welfare. 

The historical reality is that the government often has to make technology choices through 
its research allocations, regulatory decisions, and procurement choices. The reality, as noted 
by Vernon Ruttan, Emeritus Professor of Applied Economics at the University of 
Minnesota and one of the world's leading development economists, is that “government has 
played an important role in the technology development and transfer in almost every U.S. 
industry that has become competitive on a global scale.”* The table below highlights some 
of key game changing technologies that came about through government sponsorship. 


PtcEsedenti for Public Role in Comkteteiuiization of Science in thetJ.S. 
1^8. - Glatft to Ell vijumey to prbduce muskefs ^th interchangeable parts, founds 
,!,fi^t machine tSol indl&try 
’ 18jl2 - Sa&uel Morse rfeeeives award to demoi 
,1903 Brothers fly, folfiifcig the term$J 

“1915 


te feasibility of telegraph 
■f aif Army contract ' ' . fi. 

urits plats an ir.strjnit ntaljrolr tii 

Uchilolrjgt 

themitiabve 'liquitj and Hoard 
and'rmlitar.- lain males. : fo 

Govemmcnrmvestmen^jnJet Aufcral^ StaaUconductorsfc , 
Computers, Satellites. Nuclear Bttergy lay the^Foundations of the Modem r j . 
Econo my,” (Cohen.& Noll, 1992^ • • s . ? 


- Nationat Advisory Committee forAu 
the rapid advance m commercial tod mihtaiy 
191§ — Ratfio ni.inuLeteriiii' foundtil 
Membership) pf the U.S, Navy with- commen 
1940s, ’50s, ’GOs 


■s See remarks of Dr. Bruce Gtiffing, “Between Invention and Innovation: Mapping the Funding for Early 
Stage Technologies," Carnegie Conference Center, Washington, D.C.. 25 January 2001 . 

’ See National Research Council, Govemmint-Industiy Parimrships for the Devehpmeni ofNm Pechmbgm: Summary 
Report, C. Wessnet, cd. Washington, D.C.: National Academies Press, 2003, page 23. 

® Vernon Ruttan, Techmhff, Gromh, and Development; An Induced Innovation Perspective, Oxford: Oxford University 
Press, 2000. 
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• 1969-1990s - Government- investments 'create the forerunners of the Internet 

,;nv.i liuild the Global PostOoningSystem 

• Today: Cuireni investments in promising research and tcehiiolotiies are 
found in genomic and biomedical leseWch, as well as advanced Ciiiii|iiiiiiio 
and new materials, (c.g., the govemmei^s nanotechnology inifr.itives). 


The Global Competition in Innovation 

The technologies enabled by ATP investments are particularly relevant in the new 
international competitive en-vironment that the United States faces today. The increasing 
offshore movement of R&D, software development, and manufacturing poses a profound 
challenge to U.S. technical preeminence, and therefore on military preeminence. Private 
R&D by U.S. firms is increasingly spent in countries like China and India, where they are 
conducted increasingly by non-captive, independent organizations. Outsourced R&D is also 
moving up from lower-end research to the operation of major branch offices integrated into 
the worldwide operations of U.S. multinationals.*’ This represents a new competitive 
paradigm for the United States and one for which we need an effective policy response. 

The challenges do not stop -with R&D. Most other nations have created new, well funded 
programs to develop new technologies and new industries for their national economies. 

This is a global phenomenon. China is the most striking example. It has a broad array of 
programs designed to develop new technologies and to attract and grow leading industries 
such as semiconductors. While Chinese efforts are massive, they are by no means unique. 
For example, Finland, a country of five million, has a program similar to ATP, called Tekes; 
it is funded at $540 million. Belgium, a nation of ten million, has a consortium for 
microelectronics research called IMEC that is budgeted at $157 million. The EU is spending 
$22 billion in its Framework Programme of applied research, and there are proposals to 
double it. Taiwan has a superb series of programs at ITRI, funded at over $500 million. 
Other nations in Europe and Asia similarly have well-funded technology programs.’*’ 
Cooperative technology programs, like ATP and SBIR, have emerged as key elements in 
national competition for the high-technology industries of the future. 

Many corporate leaders are concerned about these trends. Dr. Mark Myers, the former head 
of R&D for Xerox, was quoted in the Wall Stmt Journal recently that "this is an increasingly 
global game, and how the U.S. fares in that [game] is uncertain.”" A well-funded ATP 
would help the United States better capitalize on its investments in basic science and R&D, 
help develop technologies -with high economic and social pay-offs, and bring small 
businesses and large businesses together to collaborate on the competitive technologies of 
the future. We need to work harder and better to compete, and ATP is and should be an 
integral part of that competitive strategy. 


’ See The Ecommisi, “Innovative India,” August 1, 2004. 

For a review of regional and national programs in semiconductors, see National Research Council, Seatring the 
Euture, Kegioml and National Program to Support the Semiconductor Industry, C. Wessner, ed., Washington, D.C.: 
National Academies Press, 2003. 
n Wall Street Journal, 1 January 2005- 
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Conclusion 

To better understand ATP and its contributions, it is important that we recognize certain 
realities, namely: 

• We need to capitalize on our research investments. We need to convert research dollars 
into products and processes that enhance the health, welfare, economic growth, and 
secmity of U.S. citizens. 

• We need to understand the inherent challenges of early-stage finance, and the 
concomitant Umitations of venture capital, both in terms of when it invests and what it 
win invest in. 

• In a global economy, we need to remember that we arc not alone. The rest of the world 
has many large, well funded programs focused on capturing new technologies for their 
national economies. These programs, especially when combined with a vibrant and 
efficient private sector, can be remarkably effective. 

• We should keep in mind that the U.S. government has long played a major role in 
developing the U.S, economy, whether it's aircraft frames, turbines, nuclear power, 
semiconductors, computers, or the Internet. Not a bad track record. 

• Perhaps most important, we should recall that these contributions to our economy are in 
turn central elements of our national security. ATP can and does make contributions to 
Homeland Security through, for example, container inspection technology, DNA 
diagnostics, and new fuel cell technologies. Appropriately funded, ATP can make major 
contributions both for homeland security and for the industrial base on which U.S. 
military strength ultimately relies. 

In sum, the National Academies “...finds that the Advanced Technology Program is 
an effective federal partnership program. The selection criteria applied by the 
program enable it to meet broad national needs and help ensure that the benefits of 
successful awards extend across firms and industries. Its cost-shared, industry- 
driven approach to funding promising new technological opportunities has shown 
considerable success in advancing technologies that can contribute to important 
societal goals. . . 

With your help and support, the ATP program will continue to contribute to the nation’s 
growth and security, 

Mr. Chairman, thank you for this opportunity to address your Committee. 


See National Research Council, The AdponcedTechnoh^ Program AssessingOutcemes, op.dt, p. 87. 
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“Why should the government fund the 
development of enabling technologies? 

"Because enabling technologies have the 
potential to bring enormous benefits to society 
as a whole. Yet private investors will not 
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technologies because profits are too uncertain or 
too distant." 

Elizabeth Downing 
3D Technology Laboratories 
NRC Report, page 65 
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A Venture Capitalist's Perspective 
on the ATP 

• "[The ATP] is an excellent program for 
developing enabling, or platform, 
technologies, which can have broad 
applications but are long-term, risky 
investments." 


• "Venture capitalists are not going to fund 
these opportunities, because they will feel that 
they are at too early a stage of maturity. 
Government can and should fund these 
technologies. In fact, it should do more than 
it is doing. David Morgenthaler 

Morgenthaler Ventures 
NRC Report, page 66 
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China’s Integrated Policy Measures to 

Support High-Technology Industries: 

Semiconductor Manufacture & Research 

• Supportive Tax Policies 

• WTO Illegal VAT Rebates 

• Incentive for Repatriation of Top Level 
Researchers and Industry Managers 

• First Class Research Facilities 

• Heavy Subsidies for Infrastructure 

• Major Tax Benefits for Individuals working in 
key Technology Industries 

• Taken together, these measures have 
powerful synergistic effects 


THE NATIONAL ACADEMIE S 


Charies W. Wessner, PhO 


ATP in International Context: 

other Countries' Support for New Technoloaies 


• TEKES in Finland 

- similar to ATP - $540 million annually 

• Semiconductor Partnerships in Japan 

- ASET Program (1995-2000) - $473 million 
» ITRI in Taiwan - over $500 annually 

• Medea II in Europe - $632 million annually 
» German Federal & State Programs 

- Pro Inno - $794 million & Inno Regio - $320 million 

• Belgium's IMEC - $157 million annually 

• European Framework Program ; $22 billion annually 

- Proposal to Double it 
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In sum, the National Academies “...finds that the 
Advanced Technology Program is an effective federal 
partnership program. The selection criteria applied 
by the program enable it to meet broad national 
needs and help ensure that the benefits of successful 
awards extend across firms and industries. 

Its cost-shared, industry-driven approach to funding 
promising new technological opportunities has 
shown considerable success in advancing 
technologies that can contribute to important societal 
goals....” 

NRC Report, page 87 


THE NATIONAl ACADEMIES 


Charles W. Wessner, PhD 


THANK YOU 


Charles W. Wessner, Ph.D. 

National Research Council 
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Washington, D.C. 20001 
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Highii^ts 

Highlights of GAO-05-759T, a report to the 
Chairman, Subcommittee on Federal 
Financiai Management, Government 
information, and International Security. 
Committee on Homeland Security and 
Governmentat Affairs, U.S. Senate 


Why GAO Did This Study 

The Advmiced Technology 
Program (ATP) supports research 
that accelerates the development of 
high-risk technologies with the 
potential for broad-based economic 
benefits for the nation. Under the 
program, administrators at the 
National Institute of Standards and 
Technology are to ensure that they 
do not fund research that would be 
conducted in the same period 
without ATP funding. Between 
1990 and September 2004, ATP 
funded 768 prqjects at a cost of 
about $2.3 billion. There is a 
continuing debate over whether the 
private sector has sufficient 
incentives to undertake research 
on high-risk, high-payoff emerging 
technologies without government 
support, such as ATP. 

This testimony discusses the 
results of GAO's April 2000 report, 
Advanced Technology Progrsuj); 
Inherent Factors in the Selection 
I^cess Could Limit Identification 
of Similar Research (GAO/RCED- 
00'114)esA provides updated 
information. GAO determined (1) 
whether ATP had funded projects 
witli research goals that were 
similar to projects ftmded by the 
private sector and (2) if ATP did, 
whether its award selection 
process ensures that such research 
would not be funded in the future. 


ADVANCED TECHNOLOGY PROGRAM 

Inherent Factors in Selection Process Are 
Likely to Limit Identification of Similar 
Research 


What GAO Found 


The three completed ATP-funded projects GAO reviewed, which were 
approved for funding in 1990 and 1992, addressed research goals that were 
similar to those already funded by tlte private sector. GAO chose these 3 
p«)jects from among the first 38 completed projects, each representing a 
different technology sector: computers, electronics, and biotechnology. 
These three technology sectors represent 26 of the 38 completed ATP 
projects, or 68 percent. The projects included an on-line handwriting 
recognition system, a system to increase the capacity of existing fiber optic 
cables for the telecommunications industry, and a process for turning 
collagen into fibers for human prostheses use. In the case of the handwriting 
recognition project, ATP provided $1.2 million to develop a system to 
recognize cursive handwriting for pen-based (i.e., without a keyboard) 
computer input. GAO identified several private firms that were (conducting 
similar research on handwriting recognition at approximately the same time 
the ATP project was funded. In fact, this line of research began in the late 
19o0s. In addition, GAO identified multiple patents, as early as 6 years prior 
to the start of the ATP project, in the field of handwriting recognition. GAO 
found similar results in the other two projects. 

'IVo inherent factors in ATP’s award selection process — the need to guEird 
against conflicts of interest and the need to protect proprietary 
information — make it unlikely that ATP can avoid funding research already 
being pursued by the private sector in the same time period. These factors, 
whicfi have not changed since 1990, make it difficult for ATP project 
reviewers to identify similar efforts in the private sector. For example, to 
guard against conflicts of interest, the program uses tecimical experts who 
are not directly involved with the proposed research. Their acquaintance 
with ongoing reseai ch is further limited by the private sector's practice of 
not disclosing its reseai'ch efforts or results so as to guard proprietary 
information. As a result, it may be impossible for the progranx to ensure that 
it is consistently not funding existing or planned research that would be 
conducted in the same time period in the absence of ATP financial 
assistance. 

GAO made no recommendations in its April 2000 report. 


www.gao.gov/cgi'bin/getrpl?GAO-05-759T. 

To view Ihe full product, including the scope 
and methodology, dick on the link above. 
For more information, contact Robin M. 
Nazzaro at (202) 512-3841or 
n^zaror@gao,gov. 
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Dear Mr. Chairman and Members of the Subcommittee; 

We are pleased to be here today to discuss our past work,' as well as to provide some 
updated information, on the funding that the Advanced Technology Program (ATP) 
provides for private research. As you know, ATP was established in 1988 to support 
research that accelerates the development of high-risk technologies with the potential 
for broad-based economic benefits for the nation.^ Under the provisions establishing 
ATP, program administrators at the National Institute of Standards and Technology 
(NIST) are to ensure that they are not funding existing or planned research that would be 
conducted in the same time period in the absence of ATP financial assistance. Between 
1990 and September 2004, ATP funded 768 projects at a cost of about $2.3 billion in 
federal matching funds. 

Research can provide both private benefits, which accrue to the owners of the research 
results, and societal benefits, which accrue to society as a whole. In some instances, the 
private sector does not fund research that would be beneficial to society because doing 
so might not provide an adequate return on a firm’s investment. To address this situation, 
the federal government, through tax credits or direct public funding, supports research 
that has very broad societal benefits, such as basic research and research focused on 
developing technologies in areas such as public health and nutrition, energy 
conservation, and environmental protection. However, there is a continuing debate over 
whether the private sector has sufficient incentives to undertake research on high-risk, 
high-payoff emerging and enabling technologies without government support, such as 
ATP. 


In this context, in our prior work, we determined (1) whether, in the past, ATP had 
funded projects with research goals that were similar to projects funded by the private 
sector and (2) if we identified such cases, whether ATFs award selection process 
ensures that such research would not be funded in the future. To determine whether ATP 
has funded projects similar to private sector projects, we chose 3 of the first 38 
completed projects, each representing a different technology sector: biotechnology; 
electronics; and information, computers, and communications. These three technology 
sectors represent 26 of the 38, or 68 percent, of the ATP projects completed by 1999. We 
reviewed the ATP project files and held discussions with industry and academic experts, 
technical reviewers, and award recipients to assist in our examination of these projects. 
We also conducted patent searches on the technical areas associated with each of the 
three projects. Our objective was not to provide an evaluation of the quality of the 
research funded by ATP or the private sector, nor the impact these projects may or may 
not have had on their respective industries. To address the second objective, we 


’ GAO, Advanced Technology Program: Inherent Factors in Selection Process Could Limit Identification of 
Similar Research. GAO/RCED-00-1 14 (Washington, D.C,: April 24, 2000). 

^ The Omnibus Trade and Competitiveness Act of 1988 (Pub. L. No. 100-418). 
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reviewed ATP’s award selection process. We did not review the overall management of 
the program. We performed our initial work from October 1999 through April 2000, and 
developed updated information in May 2006, in accordance with generally accepted 
government auditing standards. 

Results in Brief 

The three completed ATP-funded projects, which were approved for funding in 1990 and 
1992, addressed research goals that were similar to those already funded by the private 
sector. The projects included an on-line handwriting recognition system, a system to 
increase the capacity of existing fiber optic cables for the telecommunications industry, 
and a process for turning collagen into fibers for human prostheses use. In the case of 
the handwriting recognition project, ATP provided $1.2 million to develop a system to 
recognize cursive handwriting for pen-based (i.e., without a keyboard) computer input. 
We identified several private firms that were conducting similar research on handwriting 
recognition at approximately the same time the ATP project was funded. In fact, this line 
of research began in the late 1950s. In addition, we identified multiple patents, as early as 
6 years prior to the start of the ATP project, in the field of handwriting recognition. We 
found similar results in the other two projects. 


Two inherent factors in ATP’s award selection process — the need to guard against 
conflicts of interest and the need to protect proprietary information — make it unlikely 
that ATP can avoid funding research already being pursued by the private sector in the 
same time period. These factors, which have not changed since 1990, make it difficult for 
ATP project reviewers to identify similar efforts in the private sector. For example, to 
guard against conflicts of interest, the program uses technical experts who are not 
directly involved with the proposed research. Their acquaintance with on-going research 
is further limited by the private sector’s practice of not disclosing its research efforts or 
results so as to guard proprietary information. As a result, it may be impossible for the 
program to ensure that it is consistently not funding existing or planned research that 
would be conducted in the same time period in the absence of ATP financial assistance. 


Background 


ATP, which began funding projects in fiscal year 1990, was intended to fund high-risk 
research and development (R&D) projects with broad commercial and societal benefits 
that would not be undertaken by a single company or group of companies, either 
because the risk was too high or because the economic benefits of success would not 
accrue to the investors. ATP is viewed as a mechanism for fostering investment in areas 
in which societal returns would exceed private returns. ATP has addressed other 
opportunities to achieve broader societal goals, such as small business participation, as 
well as the establishment of joint ventures for high-risk technologies that would be 
difficult for any one company to justify because, for example, the benefits spread across 
the industry as a whole. Thus, ATP is seen by some as a means of addressing market 
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failure in research areas that would otherwise not be funded, thereby facilitating the 
economic growth that comes from the commercialization and use of new technologies in 
the private sector. Advocates of the program believe that the government should serve as 
a catalyst for companies to cooperate and undertake important new work that would not 
have been possible in the same time period without federal participation. Critics of the 
program view ATP as industrial policy, or the means by which government rather than 
the marketplace picks winners and losers. 


ATP provides funding through cooperative agreements — a type of financial assistance in 
which the federal government is substantially involved in project management. ATP 
offers these agreements through announced annual competitions. It provides multiyear 
funding to single companies and to industry-led joint ventures. The proposal review and 
selection process is a multistep process based on NIST regulations. In general, these 
steps include a preliminary screening, technical and business reviews, semifinalist 
identification, oral reviews, ranking, and final selection. At the beginning of each round 
of ATP competitions, NIST establishes Source Evaluation Boards (SEBs) to ensure that 
all proposals receive careful consideration. Each SEB is comprised of NIST technical 
experts as well as outside specialists with backgrounds in business and economics. ATP 
supplements the SEBs with outside technical reviewers, generally federal government 
experts in the specific industry of the proposal. Independent business experts are also 
hired on a consulting basis, including high-tech venture capitalists, people who teach 
strategic business planning, retired corporate executives from large and small high-tech 
businesses, as well as economists and business development specialists. All SEB 
members and outside reviewers must sign nondisclosure statements, agree to protect 
proprietary information, and certify that they have no conflicts of interest. 


As part of the proposal evaluation process, ATP uses the external reviewers to assess the 
technical and business merit of the proposed research. Each proposal is sponsored by 
both technical and business SEB members, whose roles include identifying reviewers, 
siunmarizing evaluative comments, and making recommendations to the SEB. The SEB 
evaluates the proposals, selects the semifinalists, conducts oral interviews with 
semifmalists, and ranks the semifmalists. A source selecting official makes the final 
award decisions based on the ranked list of proposals from the SEB. 


The three projects that we reviewed received funding through the ATP competitions 
announced in 1990 and 1992. In those years, the selection criteria included scientific and 
technical merit, potential broad-based benefits, technology transfer benefits, the 
proposing organization’s commitment level and organizational structure, and the 
qualifications and experience of the proposing organization’s staff. Each of the five 
selection criteria was weighted at 20 percent. Today, these same selection criteria are 
used but are grouped into two categories, each weighted at 60 percent. The “Scientific 
and Technical Merit” category addresses a variety of issues related to the technical plan 
and the relevant experience of the proposing organization. The second category, 
“Potential for Broad-Based Economic Benefits,” addresses the means to achieving an 
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economic benefit and commercialization plans, as well as issues related to the proposer’s 
level of commitment, organizational structure, and management plan. Technical and 
business reviewers complete documentation, referred to as technical and business 
evaluation worksheets, that address various aspects of these criteria. 

Three ATP Projects Addressed Similar Research Goals to Projects in the Private 
Sector 


The three completed projects that we reviewed addressed research goals that were 
similar to goals the private sector was addressing at about the same time. Each of the 
three projects was from a different sector of technology — computers, electronics, and 
biotechnology. The projects include (1) an on-line handwriting recognition system for 
computer input, (2) a system to increase the capacity of existing fiber optic cables for 
the telecommunications industry, and (3) a process for turning collagen into fibers for 
human prostheses use. 

ATP Project on Handwriting Recognition 


Both the ATP project and several private sector projects had a similar research goal of 
developing an on-line system to recognize natural or cursive handwritten data without 
the use of a keyboard. This technology would make computers more useful where 
keyboard use is limited by physical problems or in situations where using a keyboard is 
not practical. On-line handwriting recognition means that the system recognizes 
handwritten data while the user writes. The primary technical problem in handwriting 
recognition is that writing styles vary greatly from person to person, depending upon 
whether the user is in a hurry, fatigued, or subject to a variety of other factors. While the 
technology for obtaining recognition of constrained careful writing or block print writing 
was commercially available, systems for cursive writing recognition were not 
commercially available because of the greater handwriting variability that was 
encountered. 


The ATP project we reviewed sought to develop an on-line natural handwriting 
recognition system that was user-independent and able to translate natural or cursive 
handwriting. Communication Intelligence Corporation (CIC) was the award recipient. 
CIC used its ATP funding of $1.2 million from 1991 to 1993 to build its own algorithms 
and models for developing its handwriting recognition system.^ During the project, CIC 
created a database that includes thousands of cursive handwriting samples and 
developed new recognition algorithms. Some of this technology has been incorporated 
into a registered software product that has the ability to recognize cursive writing in 
limited circumstances. 


^ Algorithm here refers to the mathematical procedures involved in recognizing writing as it is being 
written on a computer device. 
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According to the experts we interviewed, as well as literature and patent searches, 
several companies were attempting to achieve a similar goal of handwriting recognition 
through their research around the same time that the ATP project received funding. 

Some of the key players in the private sector conducting research on cursive handwriting 
recognition included Paragraph International (in collaboration with Apple Computer) 
and Lexicus (which later became a division of Motorola). For example, Apple licensed a 
cursive handwriting recognition system from a Soviet company. Paragraph International, 
according to articles published in computer magazines in October 1991. According to 
these sources, this technology provided Apple with a foundation for recognizing printed, 
cursive, or block handwritten text. 


Another indication of research with a similar goal appeared in the October 1990 edition 
of PC Week, which reported that “handwriting recognition is an emerging technology 
that promises increased productivity both for current microcomputer owners and for a 
new breed of users armed with hand-held ‘pen-based’ computers.” Similarly a technical 
joiunal article indicated that there was renewed interest in the 1980s in this field of on- 
line handwriting recognition, from its advent in the 1960s, because of more accurate 
electronic tablets, more compact and powerful computers, and better recognition 
algorithms.' 


Moreover, according to the U.S. Patent and Trademark Office’s (PTO) database, over 450 
patents were issued on handwriting recognition software, concepts, and related products 
from 1985 through 1999,' indicating that research of a similar goal was being conducted 
around the time of the ATP project. Given the fact that it can take many years between 
the time a research project takes place and the time that an outcome is realized, this time 
period for a patent search allowed us to determine whether there was research ongoing 
during the time of the ATP project. The dates of the patents actually occurred sometime 
after the research was conducted. And, as we reported in a prior report, 'the time 
between the point when a patent application is filed until the date when a patent is 
issued, or the application is abandoned, ranged from 19.8 months to 21 months, adding 
additional time to when the research was done. 


’ IEEE Transactions on Pattern Analysis and Machine Intelligence, “The State of the Art in On-Line 
Handwriting Recognition" (Aug. 19901, vol. 12, no. 8 

A patent is a grant given by a government to an inventor of the right to exclude others for a limited time 
(usually 20 yearn) from making, using, or selling his or her invention. 

‘ GAO, Intellectual Property: Comparison of Patent Examination Statistics for Fiscal Years 1994-1995, 
GAO/ECED-97-58 (Washington, D.C., Mar. 13, 1997). 
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ATP Project on Capacity Expansion of Fiber Optic Cables 


Another ATP project we reviewed, which proposed to develop a system to increase the 
capacity of existing fiber optic cables for the telecommunications industry, also had a 
similar goal to that of research in the private sector. At the same time, Arms in the 
private sector were attempting to increase the number of light signals that can be 
transmitted through a single strand of fiber optic cable using a technology called 
wavelength division multiplexing (WDM).' In the 1980s, telephone companies laid fiber 
optic cables across the United States and other countries to create an information 
system that could cany significantly more data than the copper wires they replaced. 
Tremendous increases in cable traffic, primarily from the Internet, have crowded these 
cables. WDM technology was aimed at providing a cost-effective alternative to the 
expensive option of installing additional fiber optic cables. 


Accuwave Corporation (Accuwave) was the ATP award recipient. Accuwave used its 
ATP funding of approximately $2 million from March 1993 through March 1995 to 
develop a wavelength division multiplexing system that would substantially increase the 
number of signals that could be transmitted through a single optical fiber strand, using 
the concept of volume holography. Volume holography uses holograms to direct multiple 
light signals simultaneously through a single fiber strand. Accuwave was able to make 
improvements on these issues but not enough to fully develop and market a successful 
WDM system for the telecommunications market. In 1996, a competitor beat Accuwave 
to the market. After the completion of the ATP project, Accuwave filed for bankruptcy 
protection due to its inability to successfully commercialize a wavelength division 
multiplexing system. 


Other private firms were involved in research with a similar goal of increasing the 
capacity of fiber optic cable at about the same time as Accuwave was conducting its 
research. Conceptual research on such systems dates back to the early 1980s, but 
development and commercialization did not flourish until the mid- to late-1990s. Bell 
Labs (now Lucent Technologies), Nortel Networks, and Ciena Corporation, among 
others, were considered some of the major competitors in the industry. In the early 
1990s, these firms were attempting to develop WDM technology using different methods 
and materials. For example, Ciena Corporation developed a system that incorporated 
fiber-Bragg gratings, which are filters embedded directly onto fiber optic cable that help 
to separate multiple light signals through a single fiber strand. 


' A fiber optic cable consists of many extremely thin strands of glass or plastic, each capable of transmitting light 
signals. Wavelength division multiplexing transmits separate light signals through a single optical fiber strand at 
different wavelengths. 
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We also found an indication of WDM-related research through a review of issued patents. 
According to PTO’s database, over 2,000 patents were issued related to wavelength 
division multiplexing components, systems, and concepts from 1985 through 1999. The 
patents issued ranged from 10 patents in 1985 to 493 in 1999. 

ATP Project on Regenerating Tissues ctnd Orgims 


Both the ATP project and private sector projects we identified in the tissue engineering 
field had similar broad research goals of developing biological equivalents for defective 
tissues and organs utilizing diverse technical approaches. ATP’s project proposed 
procedures for extracting, storing, spinning, and weaving collagen (the main constituent 
of connective tissue and bones) into fibers suitable for human prostheses that could 
induce the body’s cells to regenerate lost tissue. Tissue Engineering, Inc., received ATP’s 
award of about $2 million for use over the years 1993 through 1996. The company’s long- 
term and yet unrealized goal is to transplant these prostheses into humans, after which 
the collagen framework, or scaffold, would induce the growth and function of normal 
body cells within it, eventually remodeling lost human tissue and replacing the scaffold. 


Within the very innovative field of tissue engineering, however, many competitors were 
attempting to achieve similar broad research goals. Organogenesis, the Collagen 
Corporation, Integra LifeSciences, Advanced Tissue Sciences, Genzyme Tissue, Osiris 
Therapeutics, Matrix Pharmaceuticals, and ReGen Biologies are key players in the 
market to develop structures that could replace or regenerate cells, tissues, and organs 
such as skin, teeth, orthopedic structures, cartilage, and valves. A number of these 
companies have subsequently received ATP awards. In addition, universities and medical 
schools have researchers investigating the many possibilities to engineer human tissues, 
and eventually complex organs, such as the liver, pancreas, and heart. According to one 
expert, there is a great deal of competition within the field of tissue engineering. 


Although the Tissue Engineering, Inc. research focused on the use of collagen as the 
basis for these structures, other companies were pursuing a variety of technical 
approaches for addressing the goal of developing biological equivalents for defective 
tissues and organs. In addition to research in collagen, other companies and researchers 
have also been attempting to create human tissues and organs from other biological 
materials, synthetics, and hybrid products, which are both biologic and synthetic. For 
example, researchers from the Massachusetts Institute of Technology (MIT) developed 
an artificial skin product using collagen and a natural polymer. Several companies have 
since developed comparable products. In 1986, researchers from MIT and a hospital in 
Massachusetts began inserting cells into scaffolds created of biodegradable polymer. As 
the cells multiply, tissues form. The magazine reported this concept as 

“an elegantly simple concept that underlies most engineered tissue.’’* Two competitors, 
Integra LifeSciences and Organogenesis, reported that they were also doing work on the 


* “Biotech Bodies,” BusinessWeek, Juiy 27, 1998. 
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use of collagen in various applications. Although their technical approaches were 
different than the ATP project, the broad reseeirch goals were similar. 


In addition to our discussions with experts and literature searches, patent research 
shows that there was activity related to the field of tissue engineering prior to and during 
the ATP project. According to a search done on the PTO website, at least 370 patents 
were issued related to cell culturing, scaffolding or matrix development, and tissue 
engineering from 1986 through 1999. Experts have also indicated that there are several 
patents related to the field, with a considerable amount of overlap in the technologies 
described in those patents. 

ATP’s Award Selection Process Is Unlikely to Avoid Funding Similar Research 

Two factors in ATP’s award selection process could result in ATP’s funding research 
similar to research that the private sector would fund in the same time period. These two 
factors are inherent in the review process and limit the information the reviewers have 
on similar private sector research efforts. Due to conflict-of-interest concerns, technical 
reviewers are precluded from being directly involved with the proposed research, 
making them less likely to know about all the research in an area. Also, the information 
available about private sector research is limited because of the private sector practice 
of not disclosing research results. Until a patent is issued, a private sector firm generally 
publishes very few details about the research to protect proprietary information. 
Therefore, it is difficult for the reviewers to identify other cutting-edge research. 

ATP’s Conflict-of-interest Provision Limits Its Ability to Identify Similar Research 


ATP selection officials rely on outside technical reviewers to evaluate a proposal’s 
scientific and technical merit. All reviewers must certify that they have no conflicts of 
interest. To minimize possible conflicts of interest, the technical reviewers are generally 
federal government employees who are experts in the specific technology of the 
research proposal but are not directly involved with the proposed research area. 
Although this approach helps to guard against conflict of interest, it has inherent 
limitations on the program’s ability to identify similar research efforts. The technical 
reviewers rely on their own knowledge of research underway in the private sector. One 
of the technical reviewers we interviewed said that he did not personally know of other 
companies that were doing similar work. However, he believed that it was unlikely that 
there were not dozens of others working on the same issue. 

Proprietary Information Limits ATP’s Ability to Identify Similar Research 

ATP reviewers are significantly limited in their ability to identify similar research efforts 
by an inherent lack of information on private sector research. Although ATP officials use 
several sources, such as colleagues, conferences and symposia, and current technical 
literature, to try to identify research efforts conducted by the private sector and the 
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federal government, this information is often proprietary. Most of the private sector and 
university experts we consulted agreed that it can be very difficult to identify the specific 
research that private sector firms are conducting, especially considering the competitive 
nature of most industries. The early release of information on a company’s research 
could be costly to the firm. If a competing firm could determine the nature and progress 
of another company’s research, it could help the competitor to develop and 
commercialize an identical or higher-quality product before the other firm. At the very 
least, the early release of research information by a firm can give competitors an idea as 
to the focus of the firm’s strategic plan. Thus, many firms are very careful about releasing 
detailed information related to research and development activities they are conducting. 


In conclusion, Mr. Chairman, the process ATP follows to select projects for funding is 
limited in its ability to identify similar research efforts in the private sector. Our 
retrospective look at the three ATP research projects showed that their goals were 
similar to research goals already being funded by the private sector. Examining the 
process that ATP uses to select projects, we found two inherent factors — ^the need to 
guard against conflicts of interest and the need to protect proprietary information — that 
limit ATP’s ability to identify similar research efforts in the private sector. These two 
factors have not changed since the beginning of the program. We recognize the valid 
need to guard against conflicts of interest and to protect proprietary information; thus, 
we did not recommend any changes to the award selection process. However, we believe 
that it may be impossible for the program to ensure that it is consistently not funding 
existing or planned research that would be conducted in the same time period in the 
absence of ATP financial assistance. 


Mr. Chairman, this concludes my prepared statement. I would be happy to respond to 
any questions that you or Members of the Subcommittee may have. 


Contacts and Acknowledgements 


For further information about this testimony, please contact Robin M. Nazzaro at 202- 
512-6246. Diane Raynes, Carol Hermstadt Shulman, and Jessica Evans made key 
contributions to this statement. 


(360695) 
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GAO Responses to Follow-up Questions from May 26, 2005 Hearing 

“An Assessment of Federal Funding for Private Research and Development” 

U.S. Senate Committee on Homeland Security and Governmental Affairs, 
Subcommittee on Federal Financial Management, Government Information, and International 

Security 


Questions from Senator Cobum 


The questions from Senator Cobum concerned actions by the Advanced Technology Program at 
the National Institute of Standards and Technology since 1990, which GAO has not examined. 
As a result, our responses will require extensive follow-up audit work with the agency. 

Questions from Senator Lieberman 


■ The GAO 2000 report was the basis for Ms. Nazzaro 's testimony. Although NIST was not 
a witness at this hearing, it is critical to understand their evaluation of this report. 

Please comment and provide any documentation addressing NIST's evaluation of the 
GAO study. 

The Department of Commerce’s National Institute of Standards and Technology (NIST), which 
administers the Advanced Technology Program, provided GAO with agency comments on the 
report that served as the basis for Ms. Nazzaro’s testimony. The report was entitled, Advanced 
Technology Program; Inherent Factors in Selection Process Could Limit Identification of Similar 
Research, GAO/RCED-00-1 14, from April 2000. A copy of the letter GAO received from NIST 
can be found on pages 35-38 of that report. GAO responded to these comments in the Agency 
Comments section of the report on pages 15-18. In summary, NIST disagreed with both the 
methodology that we used and the conclusions that we reached in the draft report. NIST’s 
disagreement focused on six areas, each of which we addressed in our agency comments. A 
copy of the report is attached to this document. 

Questions from Senator Laughtenberg 

■ Since a sample of three is not statistically significant, would it he a mistake to generalize 
from the study that GAO has done? Has GAO done a complete assessment of the 
Advanced Technology Program (ATP)? 

As indicated in the Scope and Methodology section of the report (pages 20-22) we did not 
attempt to generalize to the entire program. The three projects were chosen from three 
teclmology sectors: information, computers and communication; electronics; and biotechnology. 
We consulted with ATP officials at the beginning of our review regarding which technology 
sectors would provide a useful framework for our review. These officials supported our selection 
of the three industrial sectors and gave us information showing that they had each received 
increasing number of awards, since the start of the ATP. However, in its agency comments to 
GAO, ATP Director Raymond Kammer said “if it were to review all 199 projects completed to 
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date, the GAO might still have come to the same conclusion, i.e. that the research goal may have 
been similar to those funded by the private sector.” 

Over the years of the ATP, GAO has conducted a number of studies assessing various aspects of 
the ATP program. These reports address topics such as: the award selection process, carryover 
balances, implementation, research results and implementation, and indirect cost rates, A listing 
of these reports and information on obtaining copies is attached. 

■ Has ATP made changes to address the issues identified in GAO ’s 1996 report? Are there 
more recent examples of supposedly problematic projects than those identified by GAO 
and Heritage? Why haven ’t they been cited? 

In GAO’s 1996 report. Measuring Performance: The Advanced Technology Program and 
Private-Sector Funding, GAO/RCED-96-47 GAO reported that ATP has funded research 
projects that would have been funded by the private sector as well as those that would not. In 
addition, GAO stated that ATP achieves other goals, such as aiding the formation of joint 
ventures and helping companies achieve research milestones faster. We did not recommend 
actions to be taken by ATP in the report, and therefore cannot report changes to address issues 
identified in the report. Nonetheless, the most recent ATP application kit (FY 2004) requires 
applicants to explain in the Project Narrative section why the project needs taxpayer funds and 
why full private funding is not available; applicants are also asked to include any letters 
corroborating their efforts to secure other funding. 

As noted previously, sincel996 GAO has reviewed various aspects of the ATP. For the hearing, 
we were asked to discuss the report issued in 2000 which addressed (1) whether, in the past, ATP 
had funded projects with research goals that were similar to projects funded by the private sector, 
and (2) if such cases were identified, whether ATP’s current award selection process ensures that 
such research would not be funded in the future. As we stated in our conclusions, “we found two 
inherent factors — the need to guard against conflicts of interest and the need to protect 
proprietary information — that limit ATP’s ability to identify similar research efforts in the 
private sector. These two factors have not changed since the beginning of the program. We 
recognize the valid need to guard against conflicts of interest and to protect proprietary 
information; thus we are not recommending any changes to the award selection process. 
However, we believe that it may not be possible for the program to ensure that it is consistently 
not funding existing or planned research that would be conducted in the same time period in the 
absence of ATP financial assistance,” 

GAO has not investigated whether there have been more recent examples of problematic 
projects. 

• Although some ATP projects may aim toward similar goals as private sector research, 
they may take alternative approaches with greater risk and a greater reward. Would you 
still view this as duplicative? 

GAO focused its analysis on whether the three completed projects reviewed addressed research 
goals that were similar to goals that the private sector was addressing at about the same time. 
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We did not analyze whether ATP projects were duplicative. As we stated in our agency 
comments section, if the private sector is funding any of the technical approaches toward the 
broad research goal, the benefits resulting from these efforts may be realized without federal 
funding. 

• Does GAO believe that the federal government should not fund research just because the 
private sector may be funding research with the same overall goal? 

GAO’s role in the hearing was to discuss our findings regarding the ATP program and whether 
its projects addressed research goals that were similar to goals undertaken in the private sector. 
Our testimony did not address the goal of federal research. As we state in the agency comments 
section of the report, we recognize that there could be value to funding a number of technical 
approaches or to accelerating critical technologies. However, while ATP is to ensure that it is 
not funding existing or planned research that would be conducted in the same time period in the 
absence of ATP financial assistance, the fact remains that we found that the three ATP-funded 
projects that we reviewed addressed similar research goals to those already funded by the private 
sector, which is counter to P.L. 100-418, that established ATP. 

■ Should GAO's report be viewed as an evaluation of ATP? 

GAO’s report should be viewed as an evaluation of whether ATP has funded research that would 
be conducted in the same time period in the absence of ATP funding. 


Attachments: 


■ Advanced Technology Program: Inherent Factors in Selection Process Could Limit 
Identification of Similar Research (GAO/RCED-00-1 14) 

■ Summary information about past GAO work addressing ATP 
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B-283784 
April 24. 2000 

The Honorable F. James Sensenbrenner 
Chairman 

Committee on Science 

The Honorable John R. Kasich 

Chairman 

Committee on the Budget 
House of Representatives 

The Advanced Technology Program (ATP) , administered by the National 
Institute of Standards and Technology (NIST) . was established to support 
research that accelerates the development of high-risk technologies, with 
the potential for broad-based economic benefits for the nation. The 
Omnibus Trade and Competitiveness Act of 1988 (P.L. 100-4 18), which 
established ATP, states that ATP program administrators should ensure that 
they are not funding existing or planned research that would be conducted 
in the same time period in the absence of ATP financial assistance. ATP is a 
competitive cost-sharing program that since 1990 has funded 468 projects 
at a cost of about $1.5 billion in federal matching funds. As of December 
1999, 236 projects had been completed. 

Research can provide both private benefits, which accrue to the owners of 
the research results, and social benefits, which accrue to society as a 
whole. In some instances, the private sector does not fund research that 
would be beneficial to society because doing so might not provide an 
adequate return on firms’ investments. In other words, the market is unable 
to fund certain types of research either at all or at the most desirable or 
optimal level, resulting in what is commonly referred to as “market failure." 
To address this situation, the federal government, through tax credits or 
direct public funding, supports research that has very broad social benefits, 
such as basic research and research focused on developing technologies in 
areas such as public health and nutrition, energy conservation, and 
environmental protection. However, there is a continuing debate over 
whether the private sector has sufficient incentives to undertake research 
on high-risk, high-payoff emerging and enabling technologies without 
government support, such as ATP. 

Because of your concern that ATP may have funded research that was 
similar to research already being funded by the private sector, you asked us 
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to review the NIST ATP document entitled Performance of Completed 
Projects, Status Report Number 1. dated March 1999, which provided the 
status of the first 38 completed projects. As agreed with your offices, we 
determined (!) whether, in the past. ATP had funded projects with research 
goals that were similar to projects funded by the private sector and (2) if 
such cases were identified, whether ATP's current award selection process 
ensures that such research would not be funded in tlie future. To determine 
whether ATP has funded projects similar to private sector projects, we 
chose 3 of the 38 completed projects, each representing a different 
technology sector — biotechnology; electronics; and information, 
computers, and communications. These three technology sectors represent 
26 of the 38 completed ATP projects, or 68 percent. We analyzed the ATP 
project files and held discussions with industry and academic experts, 
technical reviewers, and award recipients to assist in our examination of 
these projects. We also conducted patent searches on the technical areas 
associated with each of the three projects. Our objective was not to provide 
an evaluation of the quality of the research funded by ATP or the private 
sector nor the impact these projects may or may not have had on their 
respective industries. To address the second objective, we reviewed ATP’s 
current award selection process. We did not review the overall 
management of the program. (See app. I for a detailed discussion of our 
scope and methodology.) We performed our work from October 1999 
through April 2000 in accordance with generally accepted government 
auditing standards. 


Results in Brief completed ATP-funded projects, which were approved for 

funding in 1990 and 1992, addressed similar research goals to those already 
funded by the private sector. The projects included an on-line handwriting 
recognition system, a system to increase the capacity of existing fiber optic 
cables for the telecommunications industry, and a process for turning 
collagen into fibers for human prostheses use. In the case of the 
handwriting recognition project, ATP provided $1.2 million to develop a 
system to recognize cursive handwriting for pen-based (i.e., without a 
keyboard) computer input. We identified several private firms that were 
conducting similar research on handwriting recognition at approximately 
the same time the ATP project was funded. In fact, this line of research 
began in the late 1950s. In addition, we identified multiple patents, as early 
as 5 years prior to the start of the ATP project, in the field of handwriting 
recognition. We found similar results in the other two projects. 
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Two inherent factors in ATP’s current award selection process — the need to 
guard against conflicts of interest and the need to protect proprietary 
information — make it unlikely that ATP can avoid funding research already 
being pursued by the private sector in the same time period. These factors, 
which have not changed since 1990. make it difficult for AFP project 
reviewers to identify similar efforts in the private sector. For example, to 
guard against conflicts of Interest, the program uses technical experts who 
are not directly involved with the proposed research. Their acquaintance 
with on-going research is further limited by the private sector’s practice of 
not disclosing its research efforts or results so as to guard proprietary 
information. As a result, it may not be possible for the program to ensure 
that it is consistently not funding existing or planned research that would 
be conducted in the same time period in the absence of ATP financial 
assistance. 


Background 


ATP. which began in fiscal year 1990, was initiated to fund high-risk 
research and development (R&D) projects with broad commercial and 
societal benefits that would not be undertaken by a single company or 
group of companies, either because the risk was too high or because the 
economic benefits of success would not accrue to the investors, ATP is 
viewed as a mechanism for fostering investment in areas in which social 
returns would exceed private returns. ATP has addressed other 
opportunities to achieve broader social goals such as small business 
participation, as well as the establishment of joint ventures— for high-risk 
technologies that would be difficult for any one company to justify, 
because, for example, the benefits spread across the industry as a whole. 
Thus, ATP is seen by some as a means of addressing market failure in 
research areas that would otherwise not be funded, thereby facilitating the 
economic growth that comes from the commercialization and use of new 
technologies in the private sector. Advocates of the program believe that 
the government should serve as a catalyst for companies to cooperate and 
undertake important new work that would not have been possible in the 
same time period without federal participation. Critics of the program view 
ATP as industrial policy, or the means by which government rather than the 
marketplace picks winners and losers. 

ATP’s cooperative agreements are made through announced annual 
competitions. The ATP provides multiyear funding to single companies and 
to industry-led joint ventures. The proposal review and selection process is 
a multistep process based on NIST regulations. In general, these steps 
include: a preliminary screening, technical and business reviews. 
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semifinalist identification, oral reviews, ranking, and final selection. At the 
beginning of each round of ATP competitions, NIST establishes Source 
Evaluation Boards (SEBs) to ensure that all proposals receive careful 
consideration. Each SEB is comprised of NIST technical experts as well as 
outside specialists with backgrounds in business and economics. ATP 
supplements the SEBs with outside technical reviewers, generally federal 
government experts in the specific industry of the proposal. Independent 
business experts are also hired on a consulting basis, including high-tech 
venture capitalists, people who teach strategic business planning, retired 
corporate executives from large and small high-tech businesses, as well as 
economists and business development specialists. All SEB members and 
outside reviewers must sign nondisclosure statements, agree to protect 
proprietary information, and certify that they have no conflicts of interest. 

As part of the proposal evaluation process, ATP uses the external reviewers 
to assess the technical and business merit of the proposed research. Each 
proposal is sponsored by both technical and business SEB members, 
whose roles include identifying reviewers, summarizing evaluative 
comments, and making recommendations to the SEB. The SEB evaluates 
the proposals, selects the semifinalists, conducts oral interviews with 
semifinalists, and ranks the semifinalists. A source selecting official makes 
the final award decisions based on the ranked list of proposals from the 
SEB. 

The three projects that we reviewed received funding through the ATP 
competitions announced in 1990 and 1992. In those years, the selection 
criteria included: scientific and technical merit, potential broad-based 
benefits, technology transfer benefits, the proposing organization’s 
commitment level and organizational structure, and the qualifications and 
experience of the proposing organization’s staff. Each of the five selection 
criteria was weighted at 20 percent. Today, these same selection criteria are 
used but are grouped Into two categories, each weighted 50 percent. The 
"Scientific and Technical Merit," category addresses a variety of issues 
related to the technical plan and the relevant experience of Ae proposing 
organization. The second category, “Potential for Broad-Based Economic 
Benefits.” addresses the means to achieving an economic benefit, 
commercialization plans, as well as issues related to the proposer’s level of 
commitment, organizational structure, and management plan. Technical 
and business reviewers complete documentation called technical and 
business evaluation worksheets addressing various aspects of these 
criteria. 
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Three ATP Projects 
Addressed Similar 
Research Goals to 
Projects in the Private 
Sector 


The three completed projects that we reviewed addressed research goals 
that were similar to goals that the private sector was addressing at about 
the same time. The three projects were funded in the early 1990s, and our 
efforts to locate similar research involved identifying, retrospectively, 
research that we now know was going on at that time. Each of the three 
projects was from a different sector of technology — computers, 
electronics, and biotechnology. The projects include (1) an on-line 
handwriting recognition system for computer input, (2) a system to 
increase the capacity of existing fiber optic cables for the 
telecommunications industry, and (3) a process for turning collagen into 
fibers for human prostheses use. (Apps. II through IV describe each of the 
ATP projects and the private sector research projects whose goals were 
similar to the ATP-funded projects.) 


ATP Project on Handwriting Both the ATP project and several private sector projects had a similar 
Recognition research goal of developing an on-line system to recognize natural or 

cursive handwritten data without the use of a keyboard. This technology 
would make computers more useful where keyboard use Is limited by 
physical problems or in situations where using a keyboard is not practical. 
On-line handwriting recognition means that the system recognizes 
handwritten data while the user writes. The primary technical problem in 
handwriting recognition is that writing styles vary greatly from person to 
person depending upon whether the user is in a hurry, fatigued, or a variety 
of other factors. While the technology for obtaining recognition of 
constrained careful writing or block print writing was commercially 
available, systems for cursive writing recognition were not commercially 
available because of the greater handwriting variability that was 
encountered. 

The ATP project we reviewed sought to develop an on-line natural 
handwriting recognition system that was user-independent and able to 
translate natural or cursive handwriting. Communication Intelligence 
Corporation (CIC) was the award recipient. CIC used its ATP funding of 
$1.2 million from 1991 to 1993 to build its own algorithms ^ and models for 
developing its handwriting recognition system. During the project, CIC 
created a database that includes thousands of cursive handwriting samples 


'Aigorithm here refers to the mathematicai procedures involved in recognizing writing as it 
is being written on a con^mter device. 
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and developed new recognition algorithms. Some of this technology has 
been incorporated into a registered software product that has the ability to 
recognize cursive writing in limited circumstances. 

According to the experts we interviewed, as well as literature and patent 
searches, several companies were attempting to achieve a similar goal of 
handwriting recognition through their research around the same time that 
the ATP project received ftinding. Some of the key players in the private 
sector conducting research on cursive handwriting recognition included 
Paragraph International (in collaboration with Apple Computer) and 
Lexicus (which later became a division of Motorola). For example, Apple 
licensed a cursive handwriting recognition system from a Soviet company. 
Paragraph International, according to articles published in computer 
magazines in October 1991. According to these sources, this technology 
provided Apple with a foundation for recognizing printed, cursive, or block 
handwritten text. 

Another indication of research of a similar goal appeared in the October 
1990 edition of PC Week, which reported that "handwriting recognition is 
an emerging technology that promises increased productivity both for 
current microcomputer owners and for a new breed of users armed with 
hand-held ‘pen-based’ computers.” Similarly a technical journal article 
indicated that there was renewed interest in the 1 980s in this field of on-line 
handwriting recognition, from its advent in the 1960s, because of more 
accurate electronic tablets, more compact and powerful computers, and 
better recognition algorithms.^ 


^lEEE Transactions on Pattern Analysis and Maciiine Intelligence, ‘The State of the Art in 
On-Lirre Handwritting Recognition.’ (Aug. 1990), vol. 12, no. 8. 
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Moreover, as shown in figure 1. according to the U.S. Patent and Trademark 
Office’s (PTO) database, over 450 patents^ were issued on handwriting 
recognition software, concepts, and related products from 1985 through 
1 999, indicating that research of a similar goal was being conducted around 
the time of the ATP project. Given the fact that it can take many years 
between the time a research project takes place and the time that an 
outcome Is realized, this time period for a patent search allowed us to 
determine whether there was research ongoing during the time of the ATP 
project. The dates of the patents actually occurred sometime after the 
research was conducted. And, as we reported in a prior report,^ the time 
between the point when a patent application is filed until the date when a 
patent is issued, or the application is abandoned, ranged from 19.8 months 
to 21 months, adding additional time to when the research was done. 


Figure 1; The Number of Patente issued from 1985 Through 1999 for a Handwriting Recognition System 

120 Number of patents 



Source: Prepared by GAO u$ing PTO’s data. 


patent is a grant given by a government to an inventor of the rigiit to exclude others for a 
limited time (usually 20 years) from making, using, or selling his or her invention. 

* Intellectual Property: Comparison of Patent Examination vStatistics for Fiscal Years 1994- 
1995 {GAO/RCED-97-58. Mar. 13. 1997). 
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ATP Project on Capacity Another ATP project we reviewed, which proposed to develop a system to 
Expansion of Fiber Optic increase the capacity of existing fiber optic cables for the 
Cables telecommunications industry, also had a similar goal to that of research in 

the private sector. At the same time, firms in the private sector were 
attempting to increase the number of light signals that can be transmitted 
through a single strand of fiber optic cable using a technology called 
wavelength division multiplexing (WDM). Mn the 1980s. telephone 
companies laid fiber optic cables across the United States and other 
countries to create an information system that could carry significantly 
more data than the copper wires they replaced. Tremendous increases in 
cable traffic, primarily from the Internet, have crowded these cables. WDM 
technology was aimed at providing a cost-effective alternative to the 
expensive option of installing additional fiber optic cables. 

Accuwave Corporation (Accuwave) was the ATP award recipient. 
Accuwave used its ATP funding of approximately $2 million from March 
1993 through March 1995 to develop a wavelength division multiplexing 
system that would substantially increase the number of signals that could 
be transmitted through a single optical fiber strand, using the concept of 
volume holography. Volume holography uses holograms to direct multiple 
light signals simultaneously through a single fiber strand. Accuwave was 
able to make improvements on these issues but not enough to fully develop 
and market a successful WDM system for the telecommunications market. 
In 1996. a competitor beat Accuwave to the market. After the completion of 
the ATP project. Accuwave filed for bankruptcy protection due to its 
inability to successfully commercialize a wavelength division multiplexing 
system. 

Other private firms were involved in research with a similar goal of 
increasing the capacity of fiber optic cable at about the same time as 
Accuwave was conducting its research. Conceptual research on such 
systems dates back to the early 1980s. but development and 
commercialization did not flourish until the mid- to late 1990s. Bell Labs 
(now Lucent Technologies). Nortel Networks, and Ciena Corporation, 
among others, were considered some of the major competitors in the 
industry. In the early 1990s. these firms were attempting to develop WDM 
technology using different methods and materials. For example, Ciena 


A fiber optic cable consists of many extremely thin strands of glass or plastic, each capable 
of transmitting light signals. Wavelength division multiplexing transmits separate light 
signals through a single optical fiber strand at different wavelengths. 
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Corporation developed a system that incorporated fiber-Bragg gratings, 
which are filters embedded directly onto fiber optic cable that help to 
separate multiple light signals through a single fiber strand. 

We also found an indication of WDM-related research through a review of 
issued patents. According to PTOs database, over 2,000 patents were 
issued related to wavelength division multiplexing components, systems, 
and concepts from 1985 through 1999. As shown in figure 2, the patents 
issued ranged from 10 patents in 1985 to 493 in 1999. 


Figure 2: The Number of Patents issued from 1985 Through 1999 for Wavelength Division Multiplexing Systems and 
Components 

600 Number of patents 


500 



Source: Prepared by GAO usir>g PTO's data. 


ATP Project on Both the ATP project and private sector projects we Identified in the tissue 

Regenerating Tissues and engineering field had similar broad research goals of developing biological 
Organs equivalents for defective tissues and organs utilizing diverse technical 

approaches. ATP's project proposed procedures for extracting, storing, 
spinning, and weaving collagen (the main constituent of connective tissue 
and bones) into fibers suitable for human prostheses that could induce the 
body's cells to regenerate lost tissue. Tissue Engineering, Inc., received 
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ATP’s award of about $2 million for use over the years 1993 through 1996. 
The company’s loi^-term and yet unrealized goal is to transplant these 
prostheses into humans, after which the collagen framework, or scaffold, 
would induce the growth and function of normal body cells within it, 
eventually remodeling lost human tissue and replacing the scaffold. 

Within the very innovative field of tissue engineering, however, many 
competitors were attempting to achieve similar broad research goals. 
Organogenesis, the Collagen Corporation, Integra LifeSciences, Advanced 
Tissue Sciences. Genzyme Tissue, Osiris Therapeutics, Matrix 
Pharmaceuticals, and ReGen Biologies are key players in the market to 
develop structures that could replace or regenerate cells, tissues, and 
organs such as skin, teeth, orthopedic structures, cartilage, and valves. A 
number of these companies have subsequently received ATP awards. In 
addition, universities and medical schools have researchers investigating 
the many possibilities to engineer human tissues, and eventually complex 
organs, such as the liver, pancreas, and heart. According to one expert, 
there is a great deal of competition within the field of tissue engineering. 

Although the Tissue Engineering. Inc., research focused on the use of 
collagen as the basis for these structures, other companies were pursuing a 
variety of technical approaches for addressing the goal of developing 
biological equivalents for defective tissues and organs. In addition to 
research in collagen, other companies and researchers have also been 
attempting to create human tissues and organs from other biological 
materials, synthetics, and hybrid products, which are both biologic and 
synthetic. For example, researchers from the Massachusetts Institute of 
Technology (MIT) developed an artificial skin product using collagen and a 
natural polymer. Several companies have since developed comparable 
products. In 1986, researchers from MIT and a hospital in Massachusetts 
began inserting cells into scaffolds created of biodegradable polymer. As 
the cells multiply, tissues form, The magazine JJusi/jessPPeeit reported this 
concept as “an elegantly simple concept that underlies most engineered 
tissue.”® Two competitors, Integra LifeSciences and Organogenesis, 
reported that they were also doing work on the use of collagen in various 
applications. Although their technical approaches were different than the 
ATP project, the broad research goals were similar. 


®“BJocech Bodies.” BusinessWeek. July 27. 1998. 
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In addition to our discussions with experts and literature searches, patent 
research shows that there was activity related to the field of tissue 
engineering prior to and during the ATP project. According to a search 
done on the PTO website, at least 370 patents were issued related to cell 
culturing, scaffolding or matrix development, and tissue engineering from 
1985 through 1999. Experts have also indicated that there are several 
patents related to the field, with a considerable amount of overlap in the 
technologies described in those patents. Figure 3 depicts patents issued for 
research related to tissue engineering from 1985 through 1999. 


Figure 3: The Number of Patents issued from 1985 Through 1999 Related to Tissue Engineering 

40 Number of patents 



Source; Prepared by GAO using RIO'S data. 
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ATP’s Current Award 
Selection Process Is 
Unlikely to Avoid 
Funding Similar 
Research 


Two factors in ATP’s current award selection process could result in ATP’s 
funding research similar to research that the private sector would fund in 
the same time period. These two factors are inherent in the review process 
and limit the information the reviewers have on similar private sector 
research efforts. Due to conflict-of-interest concerns, technical reviewers 
are precluded from being directly involved with the proposed research, 
making them less likely to know about all the research in an area. Also, the 
information available about private sector research is limited because of 
the private sector practice of not disclosing research results. Until a patent 
is issued, a private sector firm generally publishes very few details about 
the research to protect proprietary information. Therefore, it is difficult for 
the reviewers to identify other cutting edge research. 


ATP S Conflict-of-interest ATP selection officials rely on outside technical reviewers to evaluate a 
Provision Limits Its Ability proposal’s scientific and technical merit. All reviewers must certify that 
to Identify Similar Research they have no conflicts ofinterest. To minimize possible conflicts of interest. 

the technical reviewers are generally federal government employees who 
are experts in the specific technology of the research proposal but are not 
directly involved with the proposed research area. Although this approach 
helps to guard against conflict of interest, it has inherent limitations on the 
program’s ability to identify similar research efforts. The technical 
reviewers rely on their own knowledge of research underway in the private 
sector. One of the technical reviewers we interviewed said that he did not 
personally know of other companies that were doing similar work. 
However, he believed that it was unlikely that there were not dozens of 
others working on the same issue. 


Proprietary Information ATP reviewers are significantly limited in their ability to identify similar 
Limits ATP’s Ability to research efforts by an inherent lack of information on private sector 

Identify Similar Research research. Although ATP officials use several sources such as colleagues, 
conferences and symposia, and current technical literature, to try to 
identify research efforts conducted by the private sector and the federal 
government, this information is often proprietary. Most of the private 
sector and university experts we consulted agreed that it can be very 
difficult to identify the specific research that private sector firms are 
conducting, especially considering the competitive nature of most 
industries. The early release of information on a company’s research could 
be costly to the firm. If a competing firm could determine the nature and 
progress of another company’s research, it could help the competitor to 
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develop and commerciaiize an identical or higher-quality product before 
the other firm. At die very least, the early release of research information 
by a firm can give competitors an idea as to the focus of the firm’s strategic 
plan. Thus, many firms are very careful about releasing detailed 
information related to research and development activities they are 
conducting. 


Conclusions retrospective look at the three ATP research projects showed that their 

goals were similar to research goals already being funded by the private 
sector. Looking at the process that ATP currently uses to select projects, 
we found two inherent factors — the need to guard against conflicts of 
interest and the need to protect proprietary information~that limit ATP’s 
ability to identify similar research efforts in the private sector. These two 
factors have not changed since the beginning of the program. We recognize 
the valid need to guard against conflicts of interest and to protect 
proprietary information: thus, we are not recommending any changes to 
the award selection process. However, we believe that it may not be 
possible for the program to ensure that it is consistently not funding 
existing or planned research that would be conducted In the same time 
period in the absence of ATP financial assistance. 


Agency Comments We provided a draft of this report to the Department of Commerce for its 

review and comment. The Department’s National Institute of Standards and 
Technology (NIST), which administers the Advanced Technology Program, 
disagreed with both the methodology that we used and the conclusions that 
we reached in the draft report. NIST’s disagreement focused on six areas, 
which are discussed in the following sections. NIST's comments and an 
enclosure describing the technical approaches of the three ATP projects 
that we reviewed are in appendix V. 

First, NIST states that the report implies that the federal government 
should not fund research that shares the same overall goal as research 
funded outside of the government. We disagree. NIST believes that it is 
appropriate for the federal government to fund research projects that have 
similar research goals to research funded by the private sector as long as 
that research has an innovative technical approach and has the potential 
for broad-based economic benefits. However, the Omnibus Trade and 
Competitiveness Act, which established the ATP, states that ATP program 
administrators should ensure that they are not funding existing or planned 
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research that would be conducted in the same time period in the absence of 
ATP financial assistcince. 

Second, NIST believes that our report failed to understand and address a 
central aspect of the ATP: that it selects projects for innovative, high-risk 
technical approaches for break-through solutions to challenging problems 
and that these technical innovations offer broad potential national benefits. 
To the contrary, throughout the report we state that the goal of the program 
and the criteria for project selection support innovative research that 
accelerates the development of high-risk technologies with the potential 
for broad-based economic benefits for the nation. Furthermore, our report 
states that advocates of the program believe that the government should 
serve as a catalyst for companies to cooperate and undertake important 
new work that would not have been possible in the same time period 
without federal participation. 

Third, NIST states that our report fails to define or address the distinction 
between funding projects with similar “research goals” versus funding 
projects with “unique project-specific objectives and technical 
approaches.” We disagree. Throughout our report we distinguish between 
broad research goals and specific technical approaches. In determining 
whether, in the past. ATP had funded projects with research goals that were 
similar to projects funded by the private sector, our report identifies many 
competitors who were attempting to achieve similar broad research goals 
to those of the three ATP-funded research projects, albeit using different 
technical approaches. Our report includes descriptions of the unique 
technical approaches of the ATP-funded projects and states that the other 
firms were attempting to develop these technologies using different 
methods and materials. NIST included, as an enclosure to its comments, a 
description of the technical approaches of each of the projects, which we 
believe generally mirrors much of our descriptions of the projects, included 
in appendixes II through IV. While the ATP-funded projects had unique 
technical approaches, nevertheless, the broad research goals were similar 
to research goals of projects being funded by the private sector. 

Fourth, NIST states that our report does not discuss the competitive value 
of having differences in the technical approaches of the research within the 
broad research fields being addressed. NIST further noted that the report 
does not mention the national benefits, which would result from 
accelerating the high-risk, yet critical technology resulting from specific 
projects. We agree that there could be value to funding a number of 
technical approaches or to accelerating critical technologies. However, if 
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ATP is to ensure that it is not funding existing or planned research that 
would be conducted in the same time period in the absence of ATP 
financial assistance, the fact remains that we found that the three ATP- 
funded projects that we reviewed addressed similar research goals to those 
already funded by the private sector. If the private sector is funding any of 
the technical approaches toward the broad research goal, the benefits 
resulting from these efforts may be realized without federal funding. 

Fifth. NIST states that in conducting our review we “hand-picked” 3 of 38 
completed projects, “presumably with the intent of making the strongest 
possible argument," and that we used these projects to draw conclusions 
that are unreasonably far reaching. This assertion is not correct. We 
selected these projects without prior knowledge of the industries or the 
technological approaches of the research projects. We chose three projects 
each representing a different technology sector. These three technology 
sectors represent 26 of the 38 completed ATP projects, or 68 percent. We 
have added additional information to explain the scope and methodology 
used in our case study approach. Our conclusion based on the review of the 
three projects is that the research goals of these three projects were similar 
to research goals already being funded by the private sector. To assist in 
our examination of these projects, we held discussions with outside 
experts, as well as with ATP technical reviewers and Source Evaluation 
Board members. These outside experts helped us to understand the 
industries within which each of the projects selected as case studies were 
operating and provided their professional assessment of whether similar 
research to that undertaken by the ATP award recipient was ongoing. We 
identified two inherent factors in ATP’s current award selection process— 
the need to guard against conflicts of interest and the need to protect 
proprietary information — that led us to the conclusion that it may not be 
possible for the program to ensure that it is consistently not funding 
existing or planned research that would be conducted in the same time 
period in the absence of ATP financial assistance. This conclusion was 
based principally on our analysis of the current award selection process 
supplemented by our analysis of the three ATP-completed projects. 

Sixth. NIST stated that if we “were to review all 199 ATP completed 
projects to date, the GAO might still have come to the same conclusions, 
i.e. that the research goals may have been similar to those funded by the 
private sector.” However, NIST states that even a review of all of the 
completed projects “would utterly fail to capture the impact of the ATP." 
Our objective was not to provide an evaluation of the quality of the 
research funded by ATP or the private sector nor the impact these projects 
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may or may not have had on their respective industries. We have added this 
clarification to the report. Our review of completed projects was limited to 
identifying whether, in the past. ATP had funded projects with research 
goals that were similar to projects funded by the private sector. 


As arranged with your offices, unless you publicly announce its contents 
earlier, we plan no fiirdier distribution of this report until 30 days after its 
issuance date. At that time, we will send copies of this report to the 
appropriate House and Senate committees; interested Members of 
Congress: the Honorable William M. Daley. Secretary of Commerce; 
Raymond G. Kammer. Director, National Institute of Standards and 
Technology; and Alan Balutis, Director, Advanced Technology Program. 

If you have any questions regarding this report, please contact me at (202) 
512-3841. Key contributors to this report are listed in appendix VI. 


5 

(Ms.) Gary L. Jones 
Associate Director. Energy, Resources, 
and Science Issues 
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To determine whetl^r the Advanced Technology Program (ATP) had 
funded projecte with research goals similar to projects being funded by the 
private sector, we examined 3 of 38 completed ATP projects from ATP’s 
status report entitled Performance of Completed Projects, dated March 
1999. These projects were chosen from the following technology sectors; 
information, computers, and communication; electronics: and 
biotechnology. These three technology sectors represent 26 of the 38 
completed ATP projects, or 68 percent. We consulted with ATP officials at 
the beginning of our review regarding which technolo^ sectors would 
provide a useful framework for our review. These officials supported our 
selection of the three industrial sectors and gave us information showing 
that they had each received increasing numbers of awards, since the start 
of the ATP program. ATP funded the selected projects as a result of two 
different competitions held in 1990 and 1992, We rank-ordered all of the 
projects within the three technology sectors by dollar value. All three 
selected projects had received a medium to high dollar award from ATP. As 
with all case studies, we did not attempt to generalize to the entire 
program. 

It can be very difficult to identify the specific research that private sector 
firms are conducting. Firms are very careful about releasing detailed 
information related to research and development activities they are 
conducting given the competitive nature of most industries. Also. It can 
take many years between the time a research project takes place and the 
time that an outcome is realized. Thus, we chose projects that ATP 
awarded as a result of competitions held in the early 1990s to 
retrospectively identify similar research projects. 

To fully understand the technologies under review, we studied the official 
ATP project files, located at the National Institute of Standards and 
Technology (NIST) headquarters in Gaithersburg, Maryland, for the three 
projects we selected. According to NIST officials, all documents 
maintained in these files are considered proprietary information. Within the 
project files, we reviewed the original project proposals, technical and 
business reviewer comment sheets, sponsor summaries and 
recommendations, and the project manager’s quarterly status reports and 
final report. To ensure the confidentiality of the proprietary information, 
none of this information was shared with the experts that we consulted. 
These experts were provided project information drawn from ATP’s March 
1999 Status Report. 
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We interviewed ATP staff, outside experts, and award recipients to gain an 
understanding of each of the technology sectors and related research and 
to obtain their professional assessment of whether similar research to that 
undertaken by the ATP award recipient was being funded by the private 
sector during the same time period. To identify the ATP staff, we used 
NIST’s list of the technical and business reviewers and members of the 
Source Evaluation Board (SEB), who had reviewed the project proposals. 
We asked these reviewers to Identify additional knowledgeable contacts to 
interview and applicable reports and articles that would supplement our 
knowledge of the technologies under review. For the handwriting 
recognition project, we interviewed five NIST scientists who were either 
technical reviewers or members of the SEB related to the project and 11 
experts from industry and academia. For the electronics project, we 
interviewed four NIST scientists who were either technical reviewers or 
members of the SEB related to the project and 13 experts from industry, 
academia, or other government agencies. For the biotechnology project, 
we interviewed two NIST scientists who were technical reviewers related 
to the project and 18 experts from industry, academia, or other government 
agencies. These outside experts represented Fortune 500 companies, such 
as Lucent, Microsoft, and IBM; major universities such as MIT and the 
University of Maryland; and government agencies, such as the National 
Aeronautics and Space Administration and the National Science 
Foundation. 

We developed a structured interview to facilitate our conversations with 
the ATP staff, outside experts, and award recipients. The interview 
document provided questions that addressed issues such as the level of 
similar research at the time of the ATP funding, the identification of private 
sector firms that conducted similar research, and the innovativeness of the 
ATP proposals, among others. 

To gather published and other information about each industry, we 
conducted a literature search, as well as an Internet search. The literature 
search used technical library sources to identify both academic journal and 
industry specific publications with articles addressing the research goals 
relevant to each project. In addition, many of the technical experts 
identified articles for us that we reviewed. The Internet searches provided 
further information about the technologies under review and the private 
sector companies involved in similar research at the time that the ATP 
projects received funding. For example, we conducted a search on 
"wavelength division multiplexing” on the Internet, and we identified 
several articles related to this technology that provided background 
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information for our work. In addition, these articles provided contact 
names at some of the private firms conducting similar research and 
academic and/or consultant contacts who have expertise in the 
technologies under review. The project files at NIST provided contact 
information for the ATP award recipients. 

To show the level of related research that firms were conducting during 
and around the time ATP funded the projects we reviewed, we also 
conducted patent searches on the technical areas associated with each 
project. To conduct our patent search, we accessed the U.S. Patent and 
Trademark Office's (PTO) website (www.uspto.gov ) , which contains PTO’s 
patent data base. For each of the three technologies we reviewed, we 
conducted a full-text keyword search of the PTO’s patent data base, using 
key words that describe each technology as the criteria. For example, for 
our search for patents on related research to the ATP project on 
handwriting recognition software, we executed a search using 
“Handwriting Recognition” as the criterion. We repeated this search for 
individual years of patent issuance, beginning with 1985 and ending with 
December 1999. The patent information demonstrates that the private 
sector was working on research topics that related to the ATP projects we 
reviewed because the patents were issued after the research was 
conducted. 

We also reviewed ATP's current award selection process to determine 
whether it could ensure that ATP would not fund research similar to that 
undertaken by the private sector. This process applies to all project 
proposals submitted to the ATP program. In conducting this review, we 
examined published reports on the ATP program, legislation that created 
and shaped the ATP program, and internal NIST documentation that 
describes the rules and processes of the ATP program. We also discussed 
ATP’s award selection process with various NIST officials, including ATP 
management, project managers, and SEE members. We did not 
independently verify the data we obtained from NIST or the other entities 
we contacted. We conducted our review from October 1999 through April 
2000 in accordance with generally accepted government auditing 
standards. 
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Communication Intelligence Corporation 
Project Summary 


This ATP project received funding from the 1990 competition, the first 
solicitation for the program. The project was completed in 1993. The ATP- 
funded software technology is widely licensed, and a new product fully 
incorporating the software is due on the market soon. The company also 
has several new products related to multilingual handwriting recognition 
systems and other software technologies that have been successful in the 
marketplace. 

Project Title 

Computer Recognition of Natural Handwriting (Communication 
Intelligence Corporation (CIC)) 

Amount of Funding Granted 

$1,264,000 (58%), with CIC contributing $912,000 (42%) toward the project. 
Summary of Project Purpose 

To develop a natural handwriting data-entry system for computers for 
applications where pen-based entry works best and for use by people who 
do not or cannot use a keyboard. 

Market Data 

Dataquest, Inc., predicted the market for pen-based computers would 
increase, potentially to $13.1 billion by 1995. 

Description of Industry/Technology 

Handwriting recognition was an emerging technology promising Increased 
productivity both for microcomputer owners and for users utilizing new 
hand-held “pen-based” computers. Starting in the late 1950s, character 
recognition developed into two areas— whether the characters to be 
recognized were machine-printed or handwritten. Thus, a separate body of 
technology research grew out of the areas of machine print and 
handwritten text. For handwritten text, further research efforts were 
focused on two additional areas— printed and cursive writing. To facilitate 
handwritten text recognition, a pen-based, or stylus-based computer, 
(essentially a tablet computer) that uses an electronic pen, or stylus, in 
conjunction with a digitizing screen for data input is employed. These 
systems were expected to supplement, rather than replace, traditional 
desktop systems. There was concern, however, that high introductory 
prices and lack of consistent handwriting recognition capabilities would 
impede the growth of pen-based systems. 
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Appendix 11 

Communication Iirtellig«ice Corporation 
Project Summary 


Limitations in the technology’s accuracy rate made it unsuitable for every 
user. While the technology had the potential for expanding the use of 
computers to people who find conventional keyboards unnatural or 
intimidating, for such tasks as text editing, dictation, or taking notes in a 
meeting, its accuracy rate and speed were inconsistent. In October 1990, 
handwriting recognition systems could only interpret unconnected block 
writing, and no system offered 100 percent accuracy. Complaints about 
hardware, software, and related components were common. For example, 
processing power was often inadequate, leading to inconsistencies in the 
machine’s ability to capture data and analyze it. In addition, digitizers were 
often slow at recording the flow of the pen on the screen. This situation 
was expected to remain for the foreseeable future, until a new generation 
of hardware and software could be developed. 

CIC proposed to conduct research and development in natural or cursive 
handwriting recognition to try to provide the means by which ordinary 
handwriting skill could be used to communicate with computers for a wide 
variety of applications. 

Private Sector Research Activities 

Handwriting recognition research has focused on print recognizers and 
cursive recognizers. Unlike printed character recognition, cursive 
recognizers must determine distinct characters in a continuous string of 
writing. In addition, the natural handwriting of most people consists of a 
mix of printed and cursive; therefore, the recognizer must be able to 
determine when a break means a new word and when it does not. Cursive 
recognizers can also exhibit some uncertainty in the identification of 
words. Since most cursive recognizers are dictionary-based, the system will 
attempt to approximate the word that a sequence of characters represents 
and then cross-reference a dictionary or glossary to see if such a character 
string exists. If the recognizer is uncertain, the system will select 
alternative word possibilities. 

In October 1991. Paragraph International announced a licensing and 
development agreement with Apple Computer for Paragraph's cursive 
handwriting recognition technology. Paragraph's technology provided 
Apple with a foundation for recognizing printed, written, or block 
handwritten text. 

In 1989, Paragraph JV. the Soviet half of the joint venture, started 
developing a cursive handwriting recognition technology, in affiliation with 
two Soviet agencies: the Council for Economics and Mathematics, and the 
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Communication Intelligence Corporation 
Project Summary 


Academy of National Economics. Paragraph developed two main 
recognition technoif^es. The first. Calligrapher, is software that can 
decipher written text as it is written: in addition, it is the basis for the pen- 
based recognition system. The second technology, Parascript, is a static 
recognition system for use with an optical character reader. Lexicus, a 
division of Motorola, concentrated research on cursive recognition as well, 
as did Go Corporation, Palm Computing, and others. 

A TP Review Process 

For its technical evaluation, CIC was assessed on the quality and 
innovativeness of the proposal, coherency of the technical plan, overall 
scientific and technical merit, and staff quality, among others. The three 
technical reviewers were government scientists from NIST and DOD. For 
the technical categories, the evaluations consistently supported CIC. 

Regarding its business evaluation, CIC was assessed on several issues, such 
as potential to improve U.S. economic growth, staffing and facilities, 
evidence of commitment to complete project beyond federal grant, and 
overall business merit, among others. For business and economic related 
criteria. CIC received scores that recommended funding. 

Results/Status of Project 

CIC researchers sought to perfect software that could effectively recognize 
cursive handwriting and now has products that provide handwriting 
recognition for printed English and some foreign languages. Currently, the 
company’s core software technologies include multilingual handwriting 
recognition systems, dynamic signature verification, natural messaging, 
and operating system extensions that enable pen input. CIC describes its 
products as technologies designed to increase the ease of use, 
functionality, and security of wireless electronic devices ranging from 
handheld companions to cellular telephones. Key licensees of the 
company’s technologies include companies such as Ericsson. Fujitsu. 
Hitachi. Microsoft, Mitsubishi, and National Semiconductor. 

During the project, CIC researchers created a data base with thousands of 
cursive handwriting samples and developed new recognition algorithms. 
After analyzing the handwriting sample data base and developing the 
recognition methods, the researchers developed procedures that permit 
fast computation with modest computer memory requirements. The 
company has achieved other goals as well. For example, CIC has: 
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Project Summary 


incorporated some of the ATP-funded technology into a registered 
software product, Handwriter, which recognizes cursive writing in 
limited circumstances (previously it recognized only printing): 
licensed the Handwriter software to more than a dozen computer 
manufacturers worldwide, generating $360,000 in revenue from sales of 
30.000 units in 1997; 

launched a new product in 1996 called Handwriter MX, a stylus and 
tablet data entry device using upgraded Handwriter software; 
sold 11,000 copies of handwriter MX in 1997, with sales totaling more 
than $2.2 million: and 

received the “Ease of Use Seal of Commendation" from the 
Commendation Program of the Arthritis Foundation for the company’s 
handwriter products—indicating their value to disabled people who 
have trouble with keyboard entry. 
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Accuwave Corporation Project Summary 


This ATP project was awarded funding from the 1992 competition. 
Although Accuwave eventually filed for bankruptcy protection and was 
unable to commercialize a wavelength division multiplexing system, it did 
complete the terms of its ATP cooperative agreement by the end of the 
project in 1995. 

Project Title 

Expanding the Number of L^ht Signals in an Optical Fiber (Accuwave 
Corporation). 

Amount of Funding Granted 

$1,987,000 (69%), with Accuwave Corporation contributing $898,000 (31%) 
toward the project. 

Summary of Project Purpose 

To develop holographic-optics technology* that will increase (by more than 
10 times) the number of signals that can be transmitted through a single 
optical fiber strand. ^ This technology is based on the concept of 
wavelength division multiplexing (WDM), which transmits separate light 
signals through a single optical fiber strand at different wavelengths. 

Market Data 

According to consultants hired by Accuwave at the time of the ATP 
proposal, the total market for Accuwave’s technology was expected to 
reach $40 million. Another consulting firm estimates that by 2003, sales of 
WDM systems will reach $40 billion worldwide. 


'Holography is a technique that allows the recording and playback of true, three- 
dimensional images, called holograms. 

W fiber optic cable consists of many extremely thin strands of glass or plastic, each capable 
of transmitting light signals. 


Page 27 


GAO/RCED-00-1 14 Advanced Technology Program 




92 


Appendix lU 

Aceuwave Corptvation I^oject Summaiy 


Description of Industry/Technology 

Due to the increas«i use of telephones, fax machines, mobile telephones, 
and particularly, the Internet, U.S. telecommunication firms have 
experienced an increased demand for capacity of their transmission 
networks, which primarily consist of fiber optic cables. The installation of 
additional fiber optic cables to deal with the increase in demand for 
capacity can be very costly. WDM provides a cost-effective alternative to 
installing additional fiber optic cables. WDM allows for the simultaneous 
transmission of multiple light signals through the same fiber at different 
wavelengths. Conceptual research on WDM systems dates back to the early 
1980s. but the development and commercialization of WDM systems did 
not begin to flourish until the mid-1990s. One of the primary reasons why 
WDM had not become practical until recently was the lack of suitable 
amplifiers for signals traveling long distances.^ According to experts we 
interviewed, serious research in WDM began in the early 1990s as amplifier 
technology evolved. 

This ATP project focused on using a holography-based approach to aid in 
the development of a WDM system to increase the capacity of existing fiber 
optic cables. Aceuwave's approach employed volume holography, which 
uses a series of holograms as filters, stored in a volume of photorefractive 
(light-bending) material, to direct different light signals to separate 
wavelengths on a single fiber strand. The concept of volume holography 
dates back to the 1970s and was applied primarily to research on optical 
signal processing and memory storage. However, volume holography fell 
into disfavor during the 1980s. primarily because of two problems: 
efficiency {amount of signal loss) and reliability (deterioration of filters due 
to changes in temperature) . According to the experts we consulted, no one 
else in the industry seriously considered volume holography as a method to 
direct multiple signals onto different wavelengths of an optical fiber strand 
for telecommunications. 


^Light signals traveling through fibers fade to undetectable levels after a couple hundred 
kilometers, therefore requiring amplification to increase the strength of the signal. 
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Private Sector Research Activities 

Several private firms were involved in research activities related to WDM in 
the late 1980s and early 1990s. One of the early participants in this industry 
was AT&T and Its research arm, Bell Labs. Lucent Technologies, which 
used to be part of Bell Labs, developed an 8-waveiength WDM system in 
1995. Ciena Corporation, a company formed in 1992, received a total of $40 
million in venture capital funding and developed a 16-wavelength WDM 
system,"* which was commercially unveiled in March 1996. Several other 
companies were researching and developing WDM systems in the 1990s, 
including Nortel, Pirelli. Alcatel, and others. The other companies 
competing in this industry used different methods and materials, other than 
holographic filters, to develop their WDM systems. For example, Ciena 
Corporation used fiber-Bra^ gratings, which are filters that are written 
onto the fiber optic cable itself, to help separate multiple signals onto 
different wavelengths within a single optical fiber strand. Much of the 
research in this industry was kept proprietary and was not released to the 
public. 

ATP Review Process 

Technical reviewers from NIST, the U.S. Air Force, and the National 
Security Agency evaluated Accuwave 's proposal on issues such as quality 
and innovativeness of the proposal, coherency of the technical plan, overall 
scientific and technical merit, as well as staff quality, and others. For these 
categories, three of the four technical evaluations were consistent, stating 
that Accuwave’s proposal was innovative. The fourth technical evaluator, 
however, was more critical of the proposal, stating that Accuwave’s method 
was “another in a long line of techniques under consideration for high 
density WDM systems.” 

Business reviewers assessed Accuwave’s proposal on issues such as the 
potential to improve U.S. economic growth, staffing and facilities, evidence 
of commitment to continue project beyond federal grant, and overall 
business merit, among other items. For these categories, the business 
reviewers were critical of the proposal, citing poor commercialization 
planning, lack of manufacturing capability, etc. ATP officials, however, 
listened to the company’s oral presentation. As a result of the presentation 
and despite both technical and business reviewer concerns. ATP decided to 
fund the project. 


%DM systems with more than 8 wavelengths are called dense wavelength division 
multiplexing (DWDM) ^tems. 
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ResuJts/Status of Project 

According to a former Accuwave official, problems of efficiency and 
reliability arose during Accuwave 's research to develop a WDM system. 
Accuwave was able to make improvements on these issues but not enough 
to fully develop and market a successful WDM system for the 
telecommunications market. In addition. Ciena Corporation, a competitor, 
beat Accuwave to the market in 1996 with a 16-wavelength WDM system. 
Accuwave did not learn about Ciena until 1995, and Ciena's research was 
kept proprietary. Accuwave did commercialize a few WDM components: 
the most successful of which was called the wavelength locker, a device 
that controls the frequency of the laser. Accuwave's wavelength locker was 
a limited commercial success, according to a former Accuwave official. 
Sales of Accuwave's components reached about $3 million. According to a 
former Accuwave official, this was not enough to appease the Board 
members and the venture capitalists, and the decision was made to file for 
bankruptcy protection in October 1998. 
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This ATP proj^t was awarded funding from the 1992 competition. Tissue 
Engineering (TE) was able to successfully complete their ATP project goals 
by the end of the project in 1996. However, the company has not yet 
developed a prosfteses product that can be transplanted into humans and 
eventually be reabsorbed by the body. 

Project Title 

Prostheses Made of Biomaterials that Regenerate Body Parts {Tissue 
Engineering. Inc. (TE)] 

Amount of Funding Granted 

$1,999,000 (48%). with TE contributing $2,128,000 (52%) toward the project. 
Summary of Project Purpose 

To develop techniques for extracting and storing collagen and spinning and 
weaving collagen fibers into fabrics and other forms suitable for human 
prostheses that could induce the body's own cells to rebuild lost tissue 
while gradually replacing the prosthesis. 

Market Data 

According to BusinessWeek magazine, the president of the Pittsburgh 
Tissue Engineering Initiative research consortium has estimated that the 
potential overall market for engineered and regenerated tissues to be $80 
billion. 

Description of Industry/Tecbnology 

One industry expert said that the premise of the tissue engineering field is 
to create devices that are bio-regenerative, so that the body can eventually 
mimic and remodel what is damaged; potentially, experts believed that the 
result could be more natural than other transplants. In addition, engineered 
tissues could possibly replace donated organ transplants, which are very 
limited in supply. According to industry experts, by the early i990s. the new 
multidisciplinary field of “tissue engineering” was drawing scientific 
interest. ‘ For over a decade before. 


'In 1987. the National Science Foundation sponsored a conference where the term "tissue 
engineering" was first defined. 
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however, related basic research was being conducted. Industry experts 
explained that res^ch using synthetics as well as the protein collagen^ led 
to discoveries: scientists were looking for a way to package cells in a three- 
dimensional format, like tissues and organs. According to industry experts, 
there are remaining challenges; particularly, the challenge to develop 
products that can be reliably transplanted into and interact with the body 
without creating a negative reaction by the host. 

According to industry experts that we interviewed, tissue engineering 
research in the early 1990s focused upon synthetics and collagen 
technology for the development of products, as well as research attempting 
to understand extracellular matrix from a biological and celi biology 
perspective. ^ Some of these experts identified academic and private labs 
that were conducting research on collagen structures by 1993. 

Private Sector Research Activities 

Prior to 1992, a number of other private sector and university groups were 
also working on a variety of technical approaches to develop biological 
equivalents for defective tissues and organs for use in the human body. 
Among the groups involved in tissue engineering, the experts that we 
interviewed named the following: Organogenesis; Integra LifeSciences; 
Advanced Tissue Sciences; Collagen Corporation; Genzyme; Osiris 
Therapeutics: Matrix Pharmaceuticals: and. researchers at MIT and other 
universities, hospitals, and laboratories. A study published in the journal 
Tissue Engineering esiimdXed that the government has provided less than 
10 percent of tissue engineering funding."^ According to one industry expert, 
this may have been an advantage as it forced researchers to start 
companies and move forward, rather than spend many years in academic 
settings. Projects by other companies included attempts to bioengineer 
bone, skin, teeth, cartilage, valves, or other cells, tissues and organs. For 
example. Integra LifeSciences. Organogenesis, and Advanced Tissue 
Sciences have all been Involved in research leading to bioengineered skin. 
In addition. Genzyme Tissue. Integra LifeSciences, Advanced Tissue 


Collagen is a structural protein that occurs in vertebrates as the main constituent of 
connective Ussue fibrils and in bones. It is the most widely distributed protein in the human 
body. 

^Extracellular matrix is described as molecular networks that are cros.sIinked and are 
swollen in fluids surrounding the cells. 

“An Economic Survey of the Emerging Tissue Engineering Industry," Tissue Engineering, 
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Sciences, R^en Biologies, and Osiris Therapeutics are companies in 
competition to develop engineered cartilage products using different 
technical approaches. 

According to some of the industry experts that we interviewed, some of 
what TE proposed and did during the ATP project did not advance the core 
of the technology of regeneration. However, in 1992, the industry had not 
defined an industry-wide critical or core technology goal. The TE project 
was intended to provide a unique structural support for defective tissue to 
be gradually replaced by healthy tissue. No other therapy was available at 
the time of the award. Nonetheless, one expert described TE's technology 
as a derivative technology, rather than a high-risk and innovative 
technology. 

ATP Review Process 

During the ATP selection process, technical reviewers assessed the TE 
project on scientific and technical merit, feasibility, coherency, and 
appropriateness of staff and equipment. The three reviewers, all federal 
employees, evaluated the project as innovative. Based on these reviews, 
evaluations by three business reviewers, and a Source Evaluation Board 
decision. ATP funded the project. 

Results/Status of Project 

According to TE, the company had a profitable and rewarding start with 
the ATP award. According to the company’s founder, the ATP project was 
highly innovative because it would use naturally occurring collagen to re- 
grow tissue. The company developed a collagen spinning technique, which 
allows them to imitate the scaffolding of tissues in the body. A TE official 
claims this can be done on a commercial scale. In addition, the company 
has also been able to insert cells into the collagen to re-grow tissue in the 
laboratory. Some of the company's accomplishments include: 

• Two patents were awarded to the company for its work under the ATP 
award: “Apparatus and Method for Spinning and Processing Collagen 
Fiber”® and "Bipolymer Foams Having Extracellular Matrix 
Particulates.”® 


^“Apparatus and Method for Spinning and Processing Collagen Fiber " U.S. Patent Number 
5.562,946, panted on I0/8/I996. 

®"Bipolymer Foams Having Extracellular Matrix Particulates’" U.S. Patent Number 5,709,934. 
granted on 1/20/1 998. 
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TE indicated that it would soon begin animal trials for its orthopedic 
products and eventually progress into human trials. TE also mentioned 
that it has initiated coll^orative efforts with larger biotechnology 
companies. 
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UNtTBD BTATEa 06 PARTMSNT OP COMMERCB 
NMianBl InscICuCa of Seanciat-cla (H^d Tacdinolt^y 

C*LtMr-B9urg, \<te<>;and SDElEin 

CDFFICE OF Tl-te OtRECTCW 


iPfl |4 ara 


Ms. Gary Jones 

Associate Director, Eneigy, Resources, and 
Science Issues 

United States Goi^l Accounting Office 
Washington, D.C. 20548 

Dear Ms. Jones: 

Thank you for the opportunity to review and provide commeDts on the draft General Accounting 
Office (GAO) rqjort entitled “Advanced Technology Program: Inherent Factors in Selection 
Process Could Limit Idoitiftcation of Similar Research (GAO/RCED-00-1 14, code 141384).” 

I disagree with both the methodology used and the conclusions reached in this report. The 
implied argument is diat the Federal government should not ftind research that shares the same 
overall goal as research funded outside of the government. By that doubtful criterion we would 
shut down Federal research on cures for cancer, AIDS, and a host of other diseases; wireless 
communications; computing technologies: manufacturing; etc. 

The fundamental error in this rqport is its failure to understand and address a central a^cct of the 
Advanced Technology Program (ATP): that it selects projects for innovative, high-risk technical 
approaches for break-through solutions to challoiging problems, and that these technical 
uuiovatioos offer broad potential nationa! beneftts. This does not necessarily mean they are the 
only possible solutions. Numerous organizations, both government and private, fund research 
with similar goals. This does not mean they are funding the identical tec^cai approach to attam 
the research goal. What makes each research project unique are the pathways or technical 
^jproaches to solving the problem. This report fails to define or adrtess the distinction between 
fond^ projects with similar •‘research goals” versus funding projects with "unique project- 
specific objectives and technical appioadies.” This is a soioua error. Lumping projects logeflier 
under "research goals” is perhaps useful as a taxonomy to identify broad areas of interest, but it 
is not useful in judging the similarity of ^lecific technical approaches. 


'^ 4 / ■ 


GAO/RCED-OO-114 Advanced Technology Program 



100 


Appendix V 

Comments From the D^artment of 
Commerce 


2 

Consistent wi^i die ATP statute, ATP assists “United States businesses in creating atid applying 
the generic technology mid research reailts necessary to (1) commercialize significant new 
scientific discoverws and tecimologies rapidly.” The ATP accelerates high risk technologies 
that are unhkely to be developed in time to compete in rapidly changing global markets, or to be 
developed at all without Federal support. AT? ftmded projects are technically challenging and 
innovative, with <*jectivcs that are often well beyond state-of-the-art in their research field. 

They to tecJmically so challenging ftiat the prol^ility of failure is high and the technical 
objectives may be only partially met. The GAO report contains no reference to the high 
technical risks associated with the specific projects funded by ATP. nor the competitive value of 
haying differences in the technical ^>proache5 of the research within the broad research fields 
being addressed. Neither does the GAO rqxMt mention the national benefits which would result 
ftom accelerating the high-risk, yet critical technology resulting ftom specific projects. 

The GAO’s review hand picked 3 of 38 completed projects, prrauraably with the intent of 
making the strongest possible argument, and draws conclusions which are unreasonably far 
reaching, Even in the case of these three projects, however, the report fails to adequately assess 
the unique technical ^preaches taken in these projects, factors which played an important role in 
their selection. I append a shwt outline of Giese unique technical approaches taken by each of 
these projects. 

If It wCTe to review all 199 ATP projects completed to date, the GAO might still have come to 
the same conclusion, i.e., that the research goals may have been similar to those ftmded by the 
private sector. However, it would utterly fail to capture the impact of the ATP. On April 4, GE 
Medical Systems recognized the AT? as a “Partner in Vision” for its support in the development 
of an innovative manufacturing technology to produce large-area, fiat-panel amorphous siUcon 
detectors for X rays. These panels are the heart of a unique new digital mammography system 
^led as “flie biggest breakthrough in mammography in more than 20 years,” according to 
Senator Connie Mack. The ATP-ftmded research significantly reduced the number of processing 
steps required to manufacture these paiels and increased the yield. In the sense that it was 
previously possible to make the panels, the ATP goal was not “unique”, but the processing 
innovations can significanUy reduce the cost of these panels, making the new mammography 
more affordable and more widely available to women. Ihat is a clear benefit to rapidly bringing 
high-nsk technologies to improve die quality of life for Americans. 

hi the 10 years that ATP has been in opwation. if there was concern that ATP was funding 
research which duplicated that performed by other organizations, ATP would have received 
nuniTOus complaints ftora those organizations. This is not the case. ATP’s record speaks for 
Itself in complying with the spirit of the law of funding high risk, high pay-off. emerging and 
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ENCLOSURE 

ATP PROJECTS REFLECT UNIQUE TECHNICAL APPROACHES 

L Conunnnication Intelligence Cuporation (CIC) - Handwriting Recognition 

The goal of the Cominiinication Inttlligence Corporation (CIC) project was to develop user-ind^Mndent, 
curaive handwriting recognitioD software. This project was innovative in that the algorithms to be used 
would require the system to be “trained” to recognize a speciftc user’s handwriting, and would recognize 
crmtiguTHis characters not separated by discrete spaces. The project was unique tn its combination of 
specific algorithms and programming methodologies which, together, would lead to better ^ed and 
accuracy than dieratofore attained. (The {uoject bad a terget of 10 charactm per second with 99% 
accuracy.) Also, difTerentiating this project from oflicr ongoing efforts, the CIC software was intended to 
Iw unconstrained and adaptable to European languages. 

n. Aceuwave Corporation • Capacity Expansion of Fiber Optic Cables 

At the time the award was made, only a few WDM wavelengths had been multiplexed successfully in 
comniCTcia! systems. Accuwave’siqiproach was bo* high-risk and unique. They proposed wavelength 
multiplexing using volume hotography ~ holograms "written'' in the interior of thick crystals of 
photorefraotive materials. In die demultiplexer cr^tal, for example, the multi-wavelength light enters 
one end of the crystal and encounters a series of holographic gratings, each tuned to reflect a separate 
and specific wavelength of light while passing all other wavelengths with minimal loss. When the award 
was made, Aceuwave had already demonstrated die individual elements of a system that could multiplex 
wavelengths more than 10 times better than the current art at visible wavelengths. Under die ATP, 
Aceuwave attempted to extend this technology to the infrared wavelengths used fw long-distance 
telecommunications. If compl^ly successful with tlus high-risk innovatiOT, Aceuwave’s techoology 
would have bad the poteoli^ to increase the number of WDM wavelengths by almost three times the 
number cotnmercialired by the companies mentioned in the report, which would have greatly 
the adoption of very high-capacity telecommunications systems. 

ni. Tiuue Esgiaceriog, Inc. (TE) - Regenerating Tissues and Organs 

Tissue Engineering was funded by ATP to investigate the ctxnbination of the technologies of traditional 
weaving via felmc weaving machinery and the use of animal-derived extracellular matrix (ADMAT). 

The resultant matrix is to be used for a scaffold for a variety of tissue engineering applications. The use 
of extracellular matrix from particular animals Uiought to be very close to that of human beings are less 
likely to be rejected when used in a scaffold created from tissue woven on traditional weaving rpfi '• bi nes 
The scaffold can be seeded in a variety of ways to encourage cell growth. It will also rcsorij into the 
body as cellular growth Ukes place, thereby r^lacing the matrix wi* a body equivalent The matrix 
would be a generic solution for many plications varying from relatively simple to complex including 
skin, ligaments, teadems, and vascular systems. At the time of the fundii® of this project, cariy 1993 . 
this was a unique teclmical approach toward achieving the broad research goal of replacing human tiwuc 
in the body. Based on our mfcHmation it is still a unique meftodology that is not being pursued by 
others. Tlus was a very high risk technology and offered a unique approach which, if successful, held the 
promise of wide^xcad plicability. A variety of pilot studies have indicated that the basic hypotheses 
of this research have proven to be correct. 
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enabling technologies. To do this, ATP runs a competitive peer review process which has been 
^plauded by the Department’s Office of Inspector General as a program which “constitutes a 
best practice that should be used in other fimding programs” {Audit R^ort No. DEN-10960-9- 
0001, ATP Award Process Promotes Mait-Based Decisions). It is a merit based program which 
uses technical and business expwts to review proposals to ensure that ATP does not fiind existing 
or planned research diat would be conducted in the same time period. 

Thank you for the opportunity to provide comments. 

Sincerely, 

Raymond Kammer 
Director 

Enclosure 
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List of GAO Products on the Advanced Technology Program 

The following list of GAO products identifies the report number and date of issuance for each of 
GAO’s products addressing the Advanced Technology Program. Abstracts and the reports in 
their entirety are available on the GAO website at www.gao.gov under Reports and Testimony 
by entering a keyword or report number. 

■ Advanced Technology Program: Inherent Factors in Selection Process Are Likely to 
Limit Identification of Similar Research, GAO-05-759T, May 26, 2005 

• Advanced Technology Program: Inherent Factors in Selection Process Could Limit 
Identification of Similar Research, GAO/RCED-00-1 1 4, April 24, 2000. 

• National Institute of Standards and Technology: Carryover Balances for the Advanced 
Technology Program, RCED-00-71R, March 2, 2000 

■ Federal Research: Information on the Advanced Technology Program’s Award 
Selection, RCED-99-258R, August 3, 1999 

■ Federal Research: Challenges to Implementing the Advanced Technology Program, 
RCED/OCE-98-83R, March 2, 1998 

■ Measuring Performance: The Advanced Technology Program and Private-Sector 
Funding, RCED-96-47, January 11, 1996 

■ R&D Funding Sources for ATP Applicants, RCED/OCE-96-258R, September 20, 1996 

• Technology Program's Eligibility Determination, RCED-95-210R, June 1, 1995 

■ Advanced Technology: Proposal Review Process and Treatment of Foreign-Owned 
Businesses, RCED-94-81, January 18, 1994 

■ Federal Research: Advanced Technology Program’s Indirect Cost Rates and Program 
Evaluation Status, RCED-93-221, September 10, 1993 
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My name is Brian Riedl. I am the Grover M. Hermann Fellow in Federal 
Budgetary Affairs at The Heritage Foundation. The views I express in this testimony are 
my own, and should not be construed as representing any official position of The 
Heritage Foundation. 

Federal spending now tops $22,000 per household, the highest inflation-adjusted 
total since World War II, and $5,000 per household more than in 2001 . Budget deficits 
topping $400 billion are forecast as far as the eye can see. Given the nation’s budgetary 
challenges, the Advanced Technology Program (ATP) remains one of the least justifiable 
programs. The President and the House of Representatives both support ATP’s abolition. 
The Senate should join them. 

ATP was created in 1988, supposedly to provide research and development grants 
to help small businesses develop profitable technologies. In reality, ATP funnels taxpayer 
dollars to Fortune 500 companies. Between 1990 and 2004, 35 percent of all ATP 
funding was granted to Fortune 500 companies. Among the recipients; 

• IBM has received $ 1 27 million; 

• General Electric has received $91 million; 

• General Motors has received $79 million; and 

• Motorola and 3M have each received $44 million. 

All in all, 39 Fortune 500 companies have received a total of $732 million in ATP 
subsidies. Mr. Chairman, this is the kind of spending that outrages taxpayers. At a time 
when the federal budget is deep in the red, there is no justification for taxing waitresses in 
Tulsa, or cashiers in Flint, in order to lavish hundreds of millions of dollars on Fortune 
500 companies. 

ATP’s defenders claim that these subsidies create more technological innovation. 
They will point out all the technologies on the market that ATP funded. Of course ATP 
grants have funded some successful products. But the key question is whether the market 
would have produced those products even without ATP. Both economic theory and 
practice say yes. 

ATP does not fund basic science research. Rather, it funds the commercialization 
of research so that businesses can profit from it. Basic economic theory states that profit- 
seeking companies have every incentive to fund profitable R&D themselves. If these 
projects are as promising as claimed, the companies should have no problem convincing 
their shareholders to fund the projects, or tapping into the $ 1 50 billion that private 
investors annually spend on R&D. The 39 Fortune 500 companies that have received 
ATP funds report a combined $1.4 trillion in annual revenues. To suggest they cannot 
afford their own research and development is baseless. Yes, ATP partially funded HDTV 
and flat-panel televisions. But if they hadn’t, a line of investors and businesses surely 
would have. 

The economic argument that ATP merely subsidizes existing R&D is also backed 
up by surveys of ATP participants. Although the program is supposed to be a “financier 
of last resort” for companies that have exhausted all other options, a survey shows that 65 
percent of ATP applicants never bothered to seek any private funding before going to the 
government. And among the near-winners who claimed that ATP was their final hope, 50 
percent suddenly found private funding soon after their ATP application was rejected. 
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Among the other 50 percent who did not secure private funding, many either didn’t 
bother to look, or decided to continue playing the ATP lottery for years to come. 

Not only is ATP a give-away for wealthy companies that merely subsidizes 
existing research, but evidence shows that Uncle Sam is a poor investor. Only 1 out of 
every 3 ATP projects ever brings a new product to the market. One reason for this 
abysmal track record is that ATP officials to try minimize conflicts of interest by seeking 
outside grant reviewers with little or no knowledge of the technology markets. And even 
if they sought market knowledge, most private companies in these markets conceal their 
research agendas, leaving ATP officials to guess where the market openings are. The 
result is grants for projects that either duplicate existing private research, or are doomed 
to fail. Consequently, ATP has granted money for technologies that had already been 
developed, patented, and marketed by other companies years earlier. It has granted 
money to projects that have been discredited by their entire industry. Simply put, 
investors have better knowledge and more skill investing than government officials. 

In conclusion, technological advancement is vitally important to the nation’s 
economy. Yet when governments try to pick the market’s winners and losers by 
micromanaging technological innovation, the results will always disappoint. ATP 
subsidizes Fortune 500 companies that already have the money and incentive to fund 
their own profitable projects. Too many companies see ATP as an ATM machine to 
finance projects they would never spend their own money on. With federal spending 
growing uncontrollably, ATP should be the first place lawmakers seek savings. 


2 



107 


Appendix: 

Congress Should Follow the President and Eliminate the Advanced 
Technology Program 

Brian M. Riedl, Heritage Foundation Backgrounder Ho. 1828, March 1, 2005 


President George W. Bush’s 2006 budget request calls on Congress to 
terminate or drastically reduce funding for over 1 50 ineffective and wasteful 
programs. This is a much-needed step to control spending. 

If lawmakers want to demonstrate that they are serious about controlling 
spending, terminating these 1 50 low-priority programs is the right place to start. They 
must take these steps if they are to pave the way for reforming larger and more 
politically sensitive programs such as Social Security, Medicare, and Medicaid. The 
Advanced Technology Program (ATP), a corporate welfare boondoggle that costs 
taxpayers $150 million annually, should be the first program from the President’s list 
that Congress terminates. 

The ATP has long been considered corporate welfare at its worst. In 1988, 
America was briefly fixated on the Japanese economic “miracle.” Believing that 
Japan’s system of bypassing the free market in favor of government subsidies and 
protections to preferred businesses was the new path to prosperity. Congress created 
the ATP to “bridge the gap between the research and the market place” by providing 
matching grants to businesses engaged in commercial research in such areas as 
information technology, electronics, and biotechnology. Congress did not design the 
ATP to support basic scientific research; instead, taxpayers would fund projects with 
a “significant commercial payoff’ that could make substantial profits for businesses. 

The Japanese economy has since stagnated, and so has the ATP. Since its 
inception, the program has cost taxpayers $2 billion, with more than 35 percent going to 
Fortune 500 companies. Most ATP-funded projects could have been funded by the 
private sector, and only one-third of ATP projects successfully bring new products to the 
market. Taxpayers fund these investments, but businesses receive all the profits. 

Budget reformers from both parties have made several attempts to defund the ATP. 
Congress passed legislation eliminating the program in 1995, but President Bill 
Clinton vetoed the bill. President Clinton again blocked the elimination of the ATP in 
the following year, inducing Congress to try to reform the troubled program. These 
reforms failed to fix the program, and the House of Representatives has voted in 
every year since 2000 to terminate the ATP, only to have the Senate restore funding 
each time in conference committee. 

President Bush recently joined the movement to close down the ATP after his own 
reform attempts proved futile. Only the Senate stands in the way of saving taxpayers 
$150 million per year and setting an example for other corporate welfare programs. 
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WELFARE FOR FORTUNE 500 COMPANIES 

The Advanced Technology Program’s status as a corporate welfare program is 
beyond dispute: 

• Five companies — IBM, General Electric, General Motors, 3M, and Motorola — 
have received a combined total of $385 million in ATP grants, or 19 percent of 
total program expenditures, since 1990; 

• More than 35 percent of ATP funding' has been distributed to a group of 39 
Fortune 500 companies; and 

• These 39 companies had combined revenues of $ 1 .4 trillion in 2003 ? (See Table 

1 .) 

These corporate giveaways are unjustifiable. For example, IBM, with revenues 
that topped $89 billion in 2003, does not really need the $126 million in taxpayer funding 
that it has received since 1 990. Such companies can certainly afford to finance their own 
profitable research projects. 


'National Institute of Standards and Technology, Advanced Technology Program, “ATP Active and 
Completed Projects by State,” at www.atp.nist.gov/eao/states/statepartners.htm (February 22, 2005), and 
“ATP Awards by State,” at www.atp.nist.gov/eao/02awards state.htm (February 22, 2005). The data are 
current through February 2005. 

^Revenue figures are from “The 2004 Fortune 500,” Fortune, at www.fortune.CQm/fortune/fortune500 
(February 22, 2005). 
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Table 1 

Fortune 500 Companies Have Been Granted over $700 Million ATP Dollars 

I • 1 1 [ ! 


Fortune 500 Corporation 

F-500 

Rank 

2003 Reyenue 

ATP Grants 
1990-2004 

IBM 

9 

$89,131,000,000 

$126,583,013 

General Electric 

5 

$134,187,000,000 

$91,032,423 

General Motors 

3 

$195,645,000,000 

$78,554,789 

Motorola 

61 

$27,058,000,000 

$44,270,242 

3M 

105 

$18,232,000,000 

$44,200,860 

Honeywell International 

76 

$23,103,000,000 

$31,573,685 

Ford 

4 

$164,496,000,000 

$30,339,175 

Oracle 

208 

$9,475,000,000 

$24,623,388 

Caterpillar 

77 

$22,763,000,000 

$24,350,768 

Xerox Corp 

130 

$15,701,000,000 

$23,582,852 

Dow Chemical Co. 

44 

$32,632,000,000 

$23,041,706 

United Technologies 

51 

$31,034,000,000 

$21,943,658 

NCR 

322 

$5,598,000,000 

$21,382,928 

Eastman Chemical Co. 

317 

$5,800,000,000 

$15,623,233 

Sun Microsystems 

173 

$11,434,000,000 

$13,843,000 

DuPont 

59 

$27,730,000,000 

$12,175,975 

Praxair 

321 

$5,613,000,000 

$11,916,803 

Science Applications Inti. 

289 

$6,457,000,000 

$11,453,060 

Boeing 

21 

$50,485,000,000 

$10,102,331 

Lucent 

243 

$8,470,000,000 

$9,400,000 

Hewlett-Packerd 

11 

$73,061,000,000 

$7,804,654 

ConocoPhillips 

7 

$99,468,000,000 

$7,769,860 

Lockheed Martin 

48 

$31,844,000,000 

$7,262,632 

Edison 


$12,156,000,000 

$5,871,000 

Air Products & Chemicals 

295 

$6,297,000,000 

$4,104,914 

PPL 

324 

$5,587,000,000 

$3,840,023 

Cummins 

296 

$6,296,000,000 

$2,786,800 

CheyronTexaco 

6 

$112,937,000,000 

$2,695,200 

Northrop Grumman 

55 

$28,686,000,000 

$2,382,000 

Wyeth 

125 


$2,379,000 

Johnson & Johnson 

30 


$2,000,000 

Dana Corporation 

193 


$2,000,000 

Medtronic 

263 


$1,998,000 

Texas Instruments 

197 

$9,834,000,000 

$1,971,000 

Owens Corning 

350 

$4,996,000,000 

$1,900,000 

Armstrong Holdings 

495 

$3,259,000,000 

$1,870,000 

York International 

424 

$4,076,000,000 

$1,488,812 

Applied Materials 

392 

$4,477,000,000 

$1,297,677 

Baxter International 

220 

$9,087,000,000 

$975,000 

TOTAL 


$1,372,554,000,000 

$732,390,461 


Sources: ATP grant data (as of February 2005) is located at 
http://www.atp.nist.gov/eao/states/statepartners.htm. Revenue figures from the 2004 
Fortune 500 list, located at http://www.fortune.com/fortune/fortune500. 
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Although most Americans strongly oppose corporate welfare, programs like the 
ATP are kept alive by Members of Congress who seek to “bring home the bacon” by 
helping constituents and donors apply for grants. Yet the ATP does not bring home a 
significant amount of government spending for most lawmakers. 

While taxpayers in every state are forced to pay for the program, more than half 
of all ATP funding is distributed to companies in five states: California, Michigan, 
Massachusetts, New York, and New Jersey. (See Table 2.) Meanwhile, 29 states average 
less than $1 million each in annual grants.^ 

In short, legislators wishing to bring home the bacon should not assume that their 
constituents receive sufficient benefits to justify the cost in taxes. 


Table 2 

Five States Receive Half of All ATP Dollars 


State 

Projects 

Grants 

Percent of grant 
dollars 

California 

184 

$471,647,330 

23% 

Michigan 

54 

$222,130,375 

11% 

Massachusetts 

76 

$148,618,696 

7% 

New York 

51 

$125,416,779 

6% 

New Jersey 

36 

$110,397,147 

5% 

Total - Top five states 

401 

$1,078,210,328 

52% 





Total - All other states 

367 

$994,875,878 

48% 


For projects involving several firms, the state of the lead firm is credited with the project. 
Sources; ATP grant data (through February 2004) is located at 
http://www.atp.nist.gov/eao/states/statepartners.htm. 

ATP's database excludes nearly $200 million of ATP's $2.3 billion in grants 


SUBSIDIZING EXISTING RESEARCH 

Many people confuse the ATP’s mission with that of the National Science 
Foundation (NSF). The NSF spends over $5 billion per year supporting basic scientific 
research, such as astronomy and pure mathematics. It exists to fund basic research that, 
despite its importance, is “so far removed from commercial application that private firms 
have little incentive to undertake it on their own.”^ 

The ATP, by contrast, does not fund basic research: It commercializes research so 
that businesses can profit from it. Companies should have every incentive to fund this 
kind of profitable research on their own. Not surprisingly, businesses and investors 
already spend $150 billion annually on commercial research and development. Since 
these businesses and stockholders profit from the research, they should be the ones to 
fund it. 


National Institute of Standards and Technology, “ATP Active and Completed Projects by State” and “ATP 
Awards by State.” 

‘'U.S. General Accounting Office (now Government Accountability Office), Federal Research: Challenges 
to Implementing the Advanced Jec/mo/ogy Program, GAO/RCED/OCE--98~83R, March 2, 1998, at 
1 6} .203. 1 6.4/paprpdf2/J 601 40.pdf (February 22, 2005). 
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Instead, the ATP shifts those business expenses to the taxpayers. For example, the 
promise of huge profits is motivating several private companies to invest millions of 
dollars in high-defmition television (HDTV) technology. Yet Congress used $28 million 
of the taxpayers’ money to subsidize HDTV research by a group led by the Samoff 
Corporation and another $7.3 million for research on flat panel television by another 
group of manufacturers.® 

If these technologies will be as successful as ATP advocates claim, the businesses 
should have no problem either in funding the research internally or in recruiting outside 
investors. These grants also give the recipient companies an unfair advantage over their 
unsubsidized competitors. 

ATP officials claim that the program leads to economic groivth by funding 
innovative and profitable projects that fail to secure private funding. This is unlikely. 
Investors vote with their dollars, and a business’s inability to secure funding from 
investors signals the market’s lack of confidence that the project will succeed and earn a 
profit. 

Far from functioning as a “financier of last resort,” the ATP is the first place to 
which many businesses apply for funding. A mid- 1 990s survey revealed that 65 percent 
of ATP recipients did not seek any private funding before applying for a federal grant.* 
Program administrators responded by tightening the requirements mandating that firms 
must first seek private funding. 

Nevertheless, the application questions remain vague, and applicants have every 
incentive to overstate their efforts to obtain private funding. The Department of 
Commerce admits that “project proponents have better information than the ATP about 
the prospects for private funding, and also have an incentive to conceal this 
information.”’ Applicants, in fact, have little reason to be honest. Even under the 
tightened requirements, the ATP has approved grants to firms that refused to answer 
whether or not they attempted to obtain outside funding.* 

Of the rejected research projects, 50 percent of the “near winners” — ^which 
supposedly had already exhausted all options for private funding — found private funding 
after the ATP rejected their grant application. Of the other 50 percent, most of the 
companies had never sought private funding before applying to the ATP, and it is 
unlikely that they diligently sought private funding after rejection. Instead, many simply 
continued to reapply for ATP grants.’ 

TAXPAYER-FINANCED FAILURES 


’National Institute of Standards and Technology, Advanced Technology Program, “A Technology Boost 
for U.S. Manufacturers of Flat Panel Displays,” December 2001, p. 2, at statusreports- 
atp.nlst.gov/reports/90-0I-0060PDF.pdf(YAomSLry 24, 2005), and “Digital Video in Information Networks 
{September 1995), HDTV Broadcast Technology,” project brief, at 
jazz.nist.gov/atpcf/prjbriefs/prjbrief. cftn?ProjectNumber=95-04-0026 (February 24, 2005). 

U.S. General Accoimting Office, Measuring Performance: The Advanced Technology Program and 
Private-Sector Fundings GAO/RCED--96~47, January 1 1 , 1996, at www.gao.gov/archive/1 996/rc9604 7.pdf 
(February 22, 2005). 

’U.S. General Accounting Office, Federal Research. 

‘ibid. 

‘’Near-winners who sought private funding before applying for an ATP grant were nine times as likely to 
continue a project after being rejected as those who had not sought private funding. See U.S. General 
Accounting Office, Measuring Performance. 


7 



112 


While businesses profit from the ATP’s successes, taxpayers fund both its failures 
and its successes. Only one in three ATP projects successfully brings a new product to 
the market. The rest either fail completely or result in research that has not made it to the 
market.*® It is difficult to assess whether or not ATP officials simply approve the wrong 
applications, because program officials do not keep records of which projects are rejected 
and why. 

One reason that so many projects fail is that many ATP officials lack sufficient 
knowledge of the relevant markets. This inevitably occurs because officials seek outside 
reviewers who have no conflicts of interest with the project. Such conflicts are reduced 
by ensuring that grant reviewers have knowledge of the relevant science and technology, 
but not of the market. Accordingly, their lack of market knowledge frequently causes 
grants to be awarded to projects that the market does not demand. ' * 

Another reason that projects fail is that ATP grant reviewers do not know whether 
a certain project would duplicate research performed by other companies. Most 
businesses conceal their research agendas, not wanting to tip off their competitors. 
Consequently, ATP officials often have to guess whether a grant application represents 
new or duplicative research. This duplicative research adds little value to the relevant 
industry and provides an unfair advantage to the government-subsidized firm. 

These and other factors explain the following examples of taxpayer-financed ATP 
boondoggles: 

1 . In the early 1 990s, several private companies were investing tens of millions of 
dollars in efforts to increase the data transmission capacity of fiber optic cables. In 
1993, Accuwave applied for an ATP grant so that it could also enter this market. 
Accuwave’s approach of using “volume holography” had been so discredited by 
the rest of the industry that no other private company even considered it. Yet, 
despite an already competitive market, a discredited scientific approach, and a 
rejection recommendation from the ATP’s own business reviewers, ATP 
managers still approved the $2 million grant. Predictably, the other companies’ 
research led to more than 2,000 new patents, full market commercialization, and a 
$40 billion industry in 2003. Accuwave’s technique failed, and the firm declared 
bankruptcy in 1996. 

2. In 1991, ATP officials gave the Communications Intelligence Corporation (CIC) 
$1.2 million for initial research into computer recognition of cursive handwriting, 
despite the fact that similar technology had already been developed, patented, and 
marketed. ATP grant makers needed only to open an issue of PC Week to see how 
many other companies were concurrently improving that technology. The other 
companies’ research resulted in 450 new patents, while the taxpayer-financed CIC 
project provided negligible benefits to the industry. 

3. Agridyne Technologies received $1.2 million in 1992 for a project intended to 
reduce the human side effects of certain pesticides. Agridyne lacked the resources 


'“U.S. General Accounting Office, Federal Research. 

U.S. General Accounting Office, Advanced Technology Program: Inherent Factors in Selection Process 
Could Limit Identification of Similar Re.search, RCED-00-1 14, April 24, 2000, at 
www.gao.gOv/archive/2000/rc00 1 1 4.pdf (February 22, 2005). 

“All examples are from National Institute of Standards and Technology, Advanced Technology Program, 
“ATP Status Report Database,” at statusreports-atp.nist.gov/basic Jbrm.asp (February 22, 2005), and U.S. 
General Accounting Office, Advanced Technology Program. 
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to commercialize the product and declared bankruptcy in 1995. Biosys then 
purchased Agridyne, declined to continue the project, and declared bankruptcy a 
year later. Finally, Thermo Trilogy acquired Biosys’ s assets and patents and 
determined that the pesticide project was both obsolete and unprofitable. 

4. A group led by Boeing received $5.2 million in 1992 to develop a common 
framework for automating different types of circuit boards. Although much of the 
technology was completed, company upheavals have prevented it from being 
fully commercialized. A project review explained that participating companies 
had prioritized their own mergers and acquisitions at the expense of completing 
this project and that reductions in other government contracts created “turmoil” 
for three of the four participating corporations. 

5. ETOM Technologies received $1.4 million in 1993 to increase the storage 
capacity of compact disks. The technology was developed, but ETOM was unable 
to acquire the green lasers needed for the product. Additionally, the market for 
video-on-demand service, which would have used this technology, never 
developed. ETOM declared bankruptcy in 1998. 

6. Hampshire Instruments received $900,000 in 1 991 to improve the miniaturization 
of computer chips. Within two years, Hampshire Instruments fell into financial 
distress, declared bankruptcy, and was liquidated. No other firms have offered to 
purchase this research for further development. 

Conclusion 

Many lawmakers agree that the Advanced Technology Program is just another 
shameless exercise in taxpayer-funded corporate welfare. Before every important vote, 
however, many lawmakers ask themselves whether a future opponent could use their vote 
against them. In the ATP’s case, a vote to continue the status quo is always safe, while a 
vote to terminate could be misconstrued as a vote against business and technology. 

Legislating by worst-case political scenarios is neither a formula for effective 
public policy nor a reliable reflection of political reality. The majority of Representatives 
and Senators in the current Congress have voted to defond or significantly reduce the 
ATP at some point between 1995 and 2004. Lawmakers could easily win public support 
by explaining the importance of eliminating such uimecessary and wasteful spending. 

Eliminating the ATP is both smart public policy and smart politics. By 
eliminating the ATP, lawmakers can show taxpayers that Congress can responsibly 
confront unnecessary and wasteful government spending. 
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The Heritage Foundation is a public policy, research, and educational 
organization operating under Section 501(C)(3). It is privately supported, and receives no 
funds from any government at any level, nor does it perform any government or other 
contract work. 

The Heritage Foundation is the most broadly supported think tank in the United 
States. During 2004, it had more than 200,000 individual, foundation, and corporate 
supporters representing every state in the U.S. Its 2004 income came from the following 
sources: 


Individuals 

56% 

Foundations 

24% 

Corporations 

4% 

Investment Income 

11% 

Publication Sales and Other 

5% 


The top five corporate givers provided The Heritage Foundation with 2% of its 
2004 income. The Heritage Foundation’s books are audited annually by the national 
accounting firm of Deloitte & Touche. A list of major donors is available from The 
Heritage Foundation upon request. 

Members of The Heritage Foundation staff testify as individuals discussing their 
own independent research. The views expressed are their own, and do not reflect an 
institutional position for The Heritage Foundation or its board of trustees. 
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Mr. Riedl ATP Hearing Questions: 


> Questions from Senator Levin: 

(Geographic Distribution) 

Mr. Riedl, you seem to take issue with the ATP pro^am because there is not an even geographic distribution of 
the awards. Is there geographic distribution of: 

• ethanol tax credits (subject to a federal tax incentive of 52 cents per gallon) 

• the artificially low grazing fee for the grazing of cattle and livestock on federal lands (fee charged 
to graze on federal land is SI. 79 for one animal to graze for one month compared to 2003 average fee of 
grazing on private lands of $13.40 per head) 

• special tax deductions for oil and gas exploration and production 

• Federal farm commodity support programs for wheat, feed grains, cotton, rice, dairy and sugar 

Yes, there is a strongly unequal geographic distribution of these federal programs, which is why many of 
them should be devolved to state and local governments, where program costs can be borne by the program 
beneficiaries. In the case of farm subsidies, just 22 of the 435 House districts collect half of all farm subsidies, 
according to the Environmental Working Group. There is no national interest in such corporate welfare, and if 
lawmakers wish to lavish special interest spending on those regions, then the locals should pay the costs. 


(Communications Intelligence Corporation Failure) 

• Mr. Riedl, in your article you mention the failure of the Communication Intelligence Corporation to 
commercialize their handwriting recognition computer technology. I understand that CIC’s technology 
(developed partially with ATP funding) has been licensed for use in palm pilots, for use in smartphones 
by Sony Ericsson, and into other projects. Shouldn’t this be considered a successful ATP investment? 

Not at all. Calling this a “successful ATP investment” assumes that the federal government is the only 
entity able to provide new research and development. In other words, it is based on the misguided notion that if 
Washington doesn’t do something, no one will. But thanks to the profit motive, the private sector has already 
poured billions into these technologies and produced similar research. Taxing working Americans to subsidize 
private research so that businesses can earn even bigger profits off that research does not serve the public 
interest. It is important to note that many of ATP’s subsidies are distributed to Fortune 500 companies, rather 
than small businesses. 


> Questions from Senator Lautenberg; 

• Has ATP made changes to address the issues identified in GAO’s 1996 report? Are there more recent 
examples of supposedly problematic projects than those identified by GAO and Heritage? Why haven’t 
they been cited? 
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ATP is supposed to be a “financier of last r^ort” for companies that have exhausted all other options. 
Yet the 1 996 report shows that 65 percent of ATP applicants never bothered to seek any private funding before 
going to the government. And among the near-winners who claimed that ATP was their final hope, 50 percent 
suddenly found private funding soon after their ATP application w^ rejected. Among the other 50 percent who 
did not secure private funding, many either didn’t bother to look or decided to continue playing the ATP lottery 
for years to come. In other words, ATP functions as the financier of first resort for businesses who don’t want to 
fund their own R&D. 

Despite numerous GAO reviews since then, there is no persuasive evidence that these issues have been 
resolved. 

• Does America still face competitive pressures fix)m abroad, from countries like China and India? Would 
it be a mistake to say that ATP is no longer necessary because America no longer faces competitive 
pressures from abroad? 

Of course the United States competes in a global economy and faces competitive pressures from abroad. 
Yet taxing working Americans in order to hand out massive subsidies to Fortune 500 companies so they can 
reap additional profits off research they were already imdertaking does nothing to help American workers 
compete. Rather than serve as a “financier of last result,” for risky projects, evidence clearly shows tliat many 
businesses use ATP as a piggy bank for projects they simply don’t want to fund themselves. Also keep in mind 
that only one-third of ATP projects ever result in a product brought to the market. There are much better ways 
to help U.S. workers compete globally than dumping millions of dollars on Fortune 500 companies for projects 
that fail two-thirds of the time. 


• When a grant goes to a Fortune 500 company, does that necessarily mean that it is corporate welfare? Or 
does the federal government have a proper role in providing matching funds to large companies under 
programs like ATP? 

Yes. Government handouts to Fortune 500 companies are clearly corporate welfare. In terms of the 
taxpayers’ obligations, the 39 Fortune 500 companies that have received ATP funding since 1990 reported 
combined revenues of $1 .4 trillion in 2003. Surely businesses such as Ford, IBM, and General Motors can 
scrounge together enough money to fund their own profitable research and development projects. And if their 
combined $1.4 trillion in annual revenues are not sufficient, these Fortune 500 companies may be able to locate 
a bank or other financial institution willing to provide a loan for the type of slam dunk profitable investments 
that ATP claims to support. After all, it is the businesses - not the taxpayers funding ATP - that will get to keep 
all the profits from these investments. 


> Questions from Senator Lieberman: 

• The GAO 2000 report was the basis for Ms. Nazzaro’s testimony. Although NIST was not a witness at 
this hearing, it is critical to understand their evaluation of this report. 

Please comment and provide any documentation addressing NIST’s evaluation of the GAO 2000 study. 

NIST’s response to the 2000 GAO report is flawed for several reasons. First, by comparing the case for 
ATP with the case for federal funding of AIDS and cancer research, NIST confuses basic high-risk science 
research (where a market can underfund research) with applied, profitable commercial research (where the 
profit motive guarantees sufficient product development). 
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Second, NIST argues that while ATP may fund projects similar to those of the private sector, their 
grantees may use different methods and approaches. This is a distinction without a difference. If the approaches 
embraced by ATP were better than those funded by the private sector, then surely those projects would be 
receiving private support in addition to (or even instead of) the current private sector approaches. 

And that is the key point here - any project or method as promising as NIST suggests should have no 
problem securing private funding. Remember that The 39 Fortune 500 companies that have received ATP 
funding since 1990 reported combined revenues of $1.4 trillion in 2003. For companies short on revenues, 
banks should be able provide a loan for the slam dunk profitable projects that ATP claims to support. 
Remember, it’s the businesses that will pocket the profits, so they should pay the R&D costs. Taxpayers pay for 
enough government, they deserve a break. 
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Venture Capital Funding Reaches $21 Billion in 2004 

(Venture capital funding by industry, in millions of dollars) 


Software 

Biotechnology 

Medical Devices and 
Equipment 

Semiconductors 

Telecommunications 

Media and Entertainment 

Networking and Equipment 

IT Services 

tndustriat/Energy 

Financial Services 

Healthcare Services 

lectronics/lnstrumentation 

Computers and Peripherals 

Consumer Products and 
Services 

Business Products and 
Services 

Retailing/Distribution 

Undisclosed/Other 



Sources: FricewaterhouseCoopers, Thomsen Venture Economics. National Venture Capital Assocation 
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TOM COBURN, M.D. 

OKLAHOMA 
Phone; 202-224-5754 
fAX: 202-224-60(K 


COMMITTEE ON HOMELAND SECURITY 
AND GOVERNMENTAL AFFAIRS 


Bnltd Stares Senate 

WASHIf«rrON, DC 20S10-3604 


CHWRMAN 

SuBCOMMlITEi ON FEDERAL FlNANCtAl MANAGEMENT. 

Government Intqrmation and 
Homeland Security 


COMMITTEE ON THE JUDICIARY 


May 18, 2005 


CHAIRMAN 
SUBCOMMintEON 
iNCAfiCEBATION AND REHABILITATION 


The Honorable Carlos Gutierrez committee on Indian affairs 

Secretary 

U.S. Department of Commerce 
1401 Constitution Ave.NW 
Washington, D.C. 20230 


Dear Secretary Gutierrez: 

In the fiscal year 2002 appropriations bill for the Department of Commerce (P.L. 
107-77), S184.5 million appropriated to the Advanced Technology Program (ATP), 
of which $60.7 million was made available for new grants. On October 12, 2001, less 
than two weeks into fiscal year 2002, Advanced Cell Technology, Inc. (ACT) of 
Worcester, MA announced in a press release that it had been awarded a grant of $1.89 
million fi-ora the National Institute of Standards and Technology (NIST) through ATP. 
According to ATP, the project associated with this grant will be active through May 
2006. On November 25, 2001, ACT announced in a press release the publication of 
ACT’S research into human cloning. According to the press release, ACT “performed 
somatic cell nuclear transfer (cloning) to form preimplantation embryos.” ACT also 
promotes itself as a company that researches and applies “human embryonic stem cell 
technology.” 

As I am sure you are aware, President Bush in 2001 signed an executive order 
limiting the use of federal funds on destructive embryonic stem cell research. While the 
2001 ATP grant to ACT states that the grant “involves no issues in the use of embryonic 
cells,” I am concerned, given ACT’s history in the fields of destructive embryonic stem . 
cell research and human cloning, that taxpayer dollare may have been used to fund 
research that is restricted by federal law. In 2002 the Department of Health and Humgn 
Services (HPIS) Office of the Inspector General conducted its own investigation of 
AC'F’s use of federal grants. This particular investigation resulted in the recommendation 
that ACT refund $149,917 charged to grants provided through the National Institutes of 
Health. 


In addition to the 2001 executive order regarding federal funding of destructive 
embryonic stem cell research, there are also restrictions on the use of federal funds to 
create and destroy human embryos for research purposes. Since 1996, the Congress has 
passed into law restrictions on the use of federal funds to create or destroy human 
embryos for research purposes. However, these same restrictions do not apply to funds 
appropriated to the Dqrartment of Commerce. Since companies that are in the business of 
human cloning and embryonic stem cell research can receive federal funds through both 
HHS and the Department of Commerce, I am concerned that these companies may seek 
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money through programs such as ATP that are not subject to the same conditions as 
programs that are funded through HHS. 

In closing, I respectfiilly request a formal inquiry into any and all grants provided 
to ACT through ATP and the Department of Commerce. Citing my aforementioned 
concerns, I also respectfully request a full audit of all expenditures by ACT related to its 
2001 grant (Project #00-00-4380) provided through ATP in order to ensure that federal 
funds are not being directly or indirectly used to finance restricted activities. As a 
physician, I believe that we need to do everythitig we can to find cures to diseases such as 
Alzheimer’s and Parkinson’s while at tlie same time preserving innocent human life in all 
of its stages. As a Senator, I also believe that we need to ensure that taxpayer dollars are 
being wisely spent. If you have any questions about these requests, please contact Sean 
Davis of my staff at (202) 224-5754, 


Sincej«ly, 


Tom Cobum, M.D. 

Chairman 

Subcommittee on Federal Financial 


Management, Government Information, and 
International Security 
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TOM COBURN, M.D. 
OKLAHOMA 


COMMITTEE ON HOMELAND SECURITY 
AND GOVERNMENTALAFFAIRS 


Phone: 202-224-5754 
Fax; 202-224-6008 


CHAIRMAN 

Subcommittee on Feoeral Financuu. Management, 
Government iNfosMA-noN and 
Homeland security 


WASHINGTON, DC 2C»10-3604 COMMITTEE ON THE JUDICIARY 



May 24, 2005 


CliAIRMAN 
SuBCQMMiTTtE ON 

Incarceration and Rehabilitation 


COMMITTEE ON INDIAN AFFAIRS 

The Honorabie Carlos Gutierrez 
Secretary 

U.S. Department of Commerce 
1401 Constitution Ave. NW 
Washington, D.C. 20230 


Dear Secretary Gutierrez: 

In 1988, the Advanced Technology Program (ATP) was established by the Omnibus 
Trade and Competitiveness Act of 1988 (P.L. 100-418, 15 U.S.C. 278n) to improve the 
competitive position of United States industry. Upon amending this Act in 1992, the Congress 
noted that the U.S. was “losing badly. ..in many important emerging technologies and risks 
losing much of the... world market expected to develop by the year 2000 for products based on 
emerging technologies[.]” The Congress also stated that ATP was the “appropriate vehicle” 
through which to address issues regarding the competitiveness of American businesses. 

Even as federal funding for ATP declined from $345.0 million in fiscal year 1997 to 
$136,5 million in fiscal year 2005, the U.S. global high-technology market share remained 
steady at 3 1 percent according to data provided by the National Science Foundation. In 1 980, 
nearly eight years before the creation of ATP, the U.S. global high-technology market share was 
31 percent According to a U.S. Government Accountability Office (GAO) report released in 
2004 (GAO-04-649), “U.S. businesses are in a markedly improved competitive position 
compared with Japanese and other foreign businesses competing in the global economy.” In 
addition, the report found that the National Institute of Standards and Technology “cannot ensure 
that Advanced Technology Program funding is critical for the timely development of generic 
technologies that may be vital to the U.S. and global economies.” 

Many observers, including GAO, have also voiced concerns about ATP funding of 
research activities that either had already been undertaken or would otherwise have been 
undertaken by the private sector. A 2001 GAO report (GAO/RCED-OO-IM) identified ATP- 
sponsored resem-ch projects that duplicated private sector research efforts dating back to the late- 
1 950s. GAO also found that inherent factors in ATP’s award selection process “make it unlikely 
that ATP can avoid funding research already being pursued by the private sector[.]” The same 
report went on to state, “As a result, it may not be possible for the program to ensure that it is 
consistently not fundmg existing or planned research that would be conducted in the same time 
period in the absence of ATP financial assistance.” In yet another example of ATP funding 
research already undertaken by the private sector, a 2002 report from the Federal Reserve Bank 
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of Atlanta found that ATP “launched major efTorts to fimd... Internet tools companies during 
periods when venture fending was flowing into these sectors.” 

According to the Program Assessment Rating Tool used by the Office of Management 
and Budget to rate the effectiveness of federal programs, ATP does not address a specific 
interest, problem, or need; is not designed to have a significant impact; is not designed to make a 
unique contribution; does not demonstrate improved efficiencies and cost effectiveness in 
achieving program goals each year; and does not collaborate effectively with related programs 
that share similar goals. 

While I support efforts to spur innovation and increase the global competitiveness of 
American businesses, I have serious concerns about the ability of ATP to accomplish these goals. 
From federal fending of redundant research efforts to the lack of a significant impact in 
addressing any specific need, it appears that throughout its history this program has demonstrated 
an inability to effectively or efficiently expend taxpayer dollars. 

In light of the information cited above, please provide the following information; 

(1) Of the organizations that received grants through the Advanced Technology Program 
since 1990, what percentage did not seek private funding before requesting grants 
from ATP? Please provide a list of those organizations as well as a list of projects, 
and the size of their respective federal grants, associated with each organization. 

(2) Of the awards granted through ATP since 1990, what percentage focused on research 
not already conducted with private funds in the private sector? 

(3) Please provide a list and description of every ATP-sponsored project that focused on 
research that was either in the process of being or already had been conducted with 
private fends in the private sector. 

(4) How do ATP’s selection criteria ensure that ATP-sponsored research is not 
duplicative of past or ongoing private sector efforts? 

(5) Since 1990, how many grants awarded through ATP have gone to publicly-traded 
corporations and what is the cumulative dollar total of those grants? Please provide a 
specific list with each company name and individual grant amount. 

(6) Since 1990, what percentage of federal fends appropriated to ATP has been spent by 
ATP on activities not specifically associated with research and development such as 
marketing or promotion? 

(7) Since 1990, on average, what percentage of federal ftmds awarded to each project has 
been spent by grantees on activities not specifically associated with research and 
development? 
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Pages 

(8) Since 1990, what percentage of federal fends appropriated to ATP has been spent on 
conferences? Please provide a list of those conferences, including the date, location, 
and amount of federal money spent on each conference. 

(9) How many organizations that conduct research into human cloning or embryonic 
stem cell research have received grants from ATP? Please provide a list of each 
organization, associated project, and size of federal grant. 

I look forward to your prompt reply so that we may work together to ensure that taxpayer 
dollars are being wisely spent. If you have any questions about these requests, please contact 
Sean Davis of my staff at (202) 224-5754. 


Sincerely, 



Subcommittee on Federal Financial Management, 
Government Information, and International Security 
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Department of Commerce: Discretionary Proposal 
Advanced Technology Program (ATP) 


Budget Authority. 


Funding Summary 

(In millions of dollars) 

Change 
From 2005 


-136 


2005 2006 

Enacted Proposed 

136 


Background 

The Advanced Technology Program (ATP) supports industry- led research and development 
projects in areas of emerging technology. The Administration believes that grants to industry for 
such projects are not necessary, particularly given the growth in available sources of private 
funding, such as venture capital firms and corporate research labs. As an alternative to direct 
spending on R&D, the Administration supports permanent extension of the broadly available 
research and experimentation tax credit. The PART for this program noted that large shares of 
ATP funding have gone to major corporations, which may not be an appropriate use of Federal 
resources, and that past GAO studies found projects often have been similar to those conducted 
by firms not receiving such subsidies. 

Administration Action 

The Budget terminates ATP, providing no funding for new or prior year awards. The 2005 
appropriated level does not provide for new awards, so the program is already effectively on a 
path to termination. 

The Administration believes the program is no longer warranted in today’s research and 
development environment. To address the highest priority needs of the U.S. science and 
technology base, the Budget provides $485 million for the National Institute of Standards and 
Technology. 


20 



OMB Program Assessment Rating Tool (PART 
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FY 2004 Budget 
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FY 2004 Budget 
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Federal Grants to Advanced Cell Technology, Inc. 
BACKGROUND 

• In the fiscal year 2002 appropriations bill for the Department of Commerce (P.L. 
107-77), $184.5 million was appropriated to the Advanced Technology Program 
(ATP), of which $60.7 million was made available for new grants. 

Source: httD://wwvv.congTess.gov/cgi-lis/cpauerv/R?CDl07:FLD010:@](hr278) 


• On October 12, 2001, Advanced Cell Technology, Inc. (ACT) of Worcester, MA 
announced in a press release that it had been awarded a grant of $1.89 million 
from the National Institute of Standards and Technology (NIST) through ATP. 

Sources: http:// ww w.advancedcei l.c(Mri/200 1 - 1 0- 1 2.htm 

http://jazz.nist. gov/atpct7pribriefs/pribricF.cfm?ProiectNuinber=00-00-4380 

• On November 25, 2001, ACT announced in a press release the publication of 
ACT’S research into human cloning. According to the press release, ACT 
“performed somatic cell nuclear transfer (cloning) to form preimplantation 
embryos.” 

Source: http://w\vw.advanccdcei}.ccmi/2Q01-l l-25.htm 

• In April 2002, the Office of Inspector General (OIG) of the Department of Health 
and Human Services (HHS) released the results of its investigation into the 
misuse by ACT of funds distributed through the National Institutes of Health. 

Source: http://wwvv.access.grKi.gQv/eongres5/house/pdl71()7hrg/86435.r)df 

• The investigation began after the Secretary of HHS sought a determination of 
whether any federal funds had been used to support ACT’s human embryo 
cloning research. Federal funds appropriated through HHS are prohibited from 
being spent on human embryo cloning research (P.L. 108-447). No such 
restrictions exist for funding provided through the Department of Commerce. 

Source: httn://www.congress.gov/cgi-Iis/cDauerv/R?CDl08:FLD010:@Uhr7921 

• The HHS/OIG investigation found that ACT claimed $149,917 in “unallowable” 
costs. The HHS/OIG recommended that ACT refund the $149,917 of 
unallowable costs. 

Source: http ://www.access.gDo.gov/congress/house/Dd 171 07hrg/86435. pdf 

• The HHS/OIG also had “continuing reservations regarding ACT’s ability to 
continue as a going concern and the impact this would have on the continuity of 
research under the ongoing grants.” 

Source: httD://www,access.gpo.gov/congress/housc/Ddf/107hrg/86435.pdf 


• Finally, according to the HHS/OIG, “the question of ACT’s financial viability 
was raised in ACT’s independent auditors’ financial statement report for the two 
years ended December 31, 2000.” It is not known whether past federal grants 
made the marginal difference between the success and failure of ACT as a 
business. 

Source: http://\TO'w.access.gpo.sov/coneres.s/house/ndt7107hrg/864,'!5.ndf 
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United States 

General Accounting Office 

Washington, D.C. 20548 


Resources, Conunimity, and 
Economic Development Division 

B-27055i 

January 11, 1996 

The Honorable George E. Brown, Jr. 

Ranking Minority Member 
Committee on ^ence 
House of Representatives 

Dear Mr. Brown: 

This report responds to your request that we assess the impact of the 
Advanced Technology Program (atp), which is administered by the 
National Institute of Standards and Technology within the Department of 
Commerce, aty’s purpose is to provide support on a cost-sharing basis for 
industrial research and development projects — projects that have a 
significant potential for stimulating economic growth and improving the 
competitiveness of U.S. industry. Federal funding for atp has grown 
sharply, from $68 million in fiscal year 1993 to $341 million in fiscal year 
1995. Recently, however, budget proposals have suggested eliminating 
ATP’s funding for fiscal year 1996. 

As agreed with your office, our objective was to examine, as one way to 
assess atp’s impact, whether research projects would have been funded by 
the private sector if they had not received funds from atp. We also 
examined atp’s impact in terms of other goals of the program, such as 
aiding the formation of joint ventures, We agreed on this approach 
because of the difficulty of assessing the net impact of atp’s investments in 
technology on the economy. For example, it is difficult to establish a 
causal link between a successful project and government funding earlier in 
the project. Moreover, the impact of atp should be measured not only by 
its effect on the firms that receive funding but also by its effect on other 
firms — a difficult undertaking that our approach avoids. 

To meet our objective, we focused on two groups of An> applicants, which 
we called “winners" and “near winners.” Both groups submitted proposals 
that were rated highest during atp’s review, but the near winners did not 
ultimately receive atp funding. We surveyed by telephone all applicants 
that qualified as winners or near winners during atp’s first 4 years 
(1990-93). We achieved a 100-percent response rate from the 123 
respondents that we included in our analysis (89 winners and 34 near 
winners). We asked the near winners if they had continued their proposed 
projects using other funding sources after atp declined to fund them. 

Given the similarity in the qualifications of the proposals submitted by the 
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winners and near winners as determined by atp, another purpose of this 
question was to determine whether the winners would have been likely to 
continue their projects without atp funding. We also asked both groups if 
they had sought funding from other sources before applying to atp. This 
question provided information on whether private-sector sources had the 
opportunity to fund proposed projects before an applicant sought atp 
funding. 

In our survey, we also collected information that provides an extensive 
profile of the respondents, which we used in some of our analyses; 
additional information from this profile is provided in appendix I. 
Appendix n contains our survey questions and an aggregate list of all the 
responses, and appendix III provides further detaU about our objectives, 
scope, and methodology. 


RoSUltS in Brief fimded research projects that would have been funded by the 

private sector as well as those that would not. Half of the near winners 
continued their projects without relying on atp funding, while the other 
half discontinued their projects for various reasons. The winners were 
nearly evenly divided when asked if they would have pursued their 
projects even if they had not received atp funding. Almost all the near 
winners that continued their projects did so on a modified schedule, 
meeting the projects’ milestones later than scheduled in their proposals to 

ATP. 


In most cases, private-sector sources did not have the opportimity to fund 
ATP projects. Of the 123 applicants we surveyed, 77,^ or 63 percent, did not 
look for funding from other sources before requesting it from atp. Those 
applicants that did look for funding looked for a long time and made many 
attempts to find funding, on average. Seven applicants turned down offers 
from private sources because they could not reach an acceptable funding 
arrangement. 

Our survey also found that atp had other effects. More than three-fourths 
of the joint-venture applicants indicated that they had come together 
solely to pursue an atp project, thus satisfying atp’s goal of serving as a 
catalyst for the formation of joint ventures. Furthermore, of the 45 
applicants that tried to find funding elsewhere before turning to atp, about 
half were told by prospective funders that their projects were either too 


'One ^plicant did not know. 
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risky or “precompetitive”^ — characteristics that fulfill the £dms of atp 
funding. 


Background 


ATP’s mission is to stimuMe economic growth in the United States through 
technology development The program seeks to accomplish that mission 
by sharing the cost of industrial resem*ch and development projects. The 
projects selected by atp for funding are characterized by “a potential 
broad-based economic impact but a relatively high technical risk and a 
long time horizon,” according to atp. 

A'fP’s guidance states that if the technical risk associated with a project is 
very low, federal funding should not be necessary. In addition, when 
submitting a research proposal, applicants must sign a form stating that 
“this proposal is not requesting funding for existing or planned research 
programs that would be conducted in the same time period in the absence 
of financial assistance under the atp.” This wording suggests that atp 
should not fund projects that other sources would have funded or, when 
ATP does fund such projects, that atp funds should enable applicants to 
complete their projects in a shorter time. 


Applicants’ Actions 
and Intentions to Find 
Funding Before 
Applying to ATP 


Most ATP applicants did not look for funding from other sources before 
requesting it from atp. In addition, the applicants were about evenly 
divided when asked if they intended to pursue their projects whether or 
not they received atp funding. 

When asked if they had searched for funding from other sources before 
applying to atp, 63 percent of the applicants (77 of 123; one applicant did 
not know) said that tiiey had not. Considering the winners and near 
winners separately, we found that 65 percent (58 of 89) of the winners had 
not looked for funding before applying to atp, along with 56 percent (19 of 
34) of the near winners. 


Of the 45 applicants that had looked for funding before applying to atp, 
about 53 percent (24 of 45) sought it from private sources only, 9 percent 
(4) from public sources only, and 38 percent (17) from some combination 
of private and public sources. On average, 42 of these 45 respondents (3 
did not respond) searched for funding for 18 months before applying to 
ATP and made eight separate attempts to find funding. 


^'•Prcconipetitive’ refers to the sta^e during research and de\'elopmont at which a preliminary 
assessment of a technology’s commercial potential can be made but before commercial protores arc 
developed. 
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When asked what reasons the non-ATP sources gave for not providing 
funding, 54 percent of these ^plicants (22 of 41; 4 did not respond) said 
that their projects were viewed as either too risky or 
“precompetitive” — both outlined in Commerce's regulations as reasons for 
ATP to fund projects. Sixteen percent (7 of 45) said they had turned down 
funding offers because they could not agree on terms with the prospective 
funder; 3 of these 7 eventually received atp funding. 

We asked the winners and near winners if they intended to pursue their 
projects whether or not they received ATP funding. When we considered 
the two groups together, 42 percent (52 of 123) said “yes” or “probably 
yes;” 41 percent (51) said “no" or “probably no;” and 16 percent (20) were 
uncertain. Of the respondents that said they intended to pursue the 
project, 94 percent (49 of 52) indicated that their projects’ schedules 
would be modified and that the milestones would be met later than 
scheduled in their proposals to atp. When w’e considered the atp winners’ 
answers alone, 40 percent (36 of 89) said “yes” or “probably yes;” 

16 percent (14) were undecided; and 44 percent (39) said “no” or “probably 
no.” 

Most of the joint-venture applicants came together to apply to atp. 
Seventy-six percent (26 of 34) said they had formed a new group to pursue 
the projects described in their atp proposals. The remaining joint-venture 
applicants had worked together before applying to atp, pursuing either the 
projects that they proposed to atp or other projects. 


Near Winners’ Actions declined to fund their proposals, half of the near winners 

A ft- A'P'D n r /-» + continued their projects using other funding sources. The near winners 

Alter A1 L)eClineCt to with certain characteristics were more likely to continue their projects 

Fund Their Proposals ^^n others.^ 


Half of Near Winners Half of the near winners (14 of 28) continued their projects using other 

Continued Projects Using funding sources after atp declined to fund them. These other funding 
Other Funding Sources sources included federal government programs other than atp; state 

government agencies; and private funders, such as industry groups or 
trade associations, other private companies, venture capitalists, and the 
company itself. All 14 near winners used some private funding to continue 


®In our nndin^ for this section only, the total of near winnere drops to 28 because 6 of the near 
winners were panted funding by ATP in a subsequent round of competition. Thus, wc eliminated them 
from consideration here, focu^g only on those ^at found funding from sources other than ATP. 
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their projects; 8 of tihese financed their projects using private ftmds only.^ 
Ninety-three jiercent (13 of 14) of the projects that were continued were or 
are being carried out on a modified schedule, meeting their milestones 
later than scheduled in the proposals submitted to atp. 


Some Groups of Applicants 
Were More Likely Than 
Others to Continue Their 
Projects Using Other 
Funding Sources 


Some near winners were more likely than others to continue their projects 
after atp declined to fund them. For example, 86 percent (12 of 14) of the 
near winners whose projects were under way before they applied to ATi> 
continued them, compared with 14 percent (2 of 14) of those whose 
projects were not under way. Similarly, 77 percent (10 of 13) of the neeir 
winnere that had looked for funding from other sources before applying to 
ATP continued, compared with 27 percent (4 of 15) that had not looked for 
funding before applying. Table 1 groups the near winners according to 
different characteristics and shows odds ratios, which indicate the degree 
of association between the characteristics of these groups and the 
likelihood of their continuing their projects. Odds ratios measure the 
association between two variables through a single value. The closer the 
odds ratio is to 1.00, the weaker the association. For more information on 
odds ratios, see appendix HI. 


^Some of the near winners that continued their projects using other funding sources likely benefited, 
during their search for other funding, from having been rated highly by ATP. We did not evaluate the 
extent to which this “halo effect may have occurred; however, we acknowledge that a high rating 
from ATP mi^t haw proved beneficial to some near winners. 
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Table 1: Odds Ratios Showing 
Association Between Characteristics 
of Certain Near Winners and 
Continuation of Their Projects 


Characteristics of near 
winner A 

Characteristics of near 
winner B 

Odds ratio: How many 
times more likely was 
near winner A to continue 
the project than near 
winner B? 

Project under way before 
near winner applied to ATP 

Project not under way 
before near winner applied 
to ATP 

36 

Looked for funding from other 
sources bef^e applying to 
ATP 

Did not look for funding 
from other sources before 
applying to ATP 

9.17 

Funds 50 percent or more of 
research and development 
internally 

Funds less than 50 percent 
of research and 
development internally 

2.5*^ 

Single applicant 

Joint venture 

2.75 

Company with more than 10 
FTEs'’ 

Company with 10 or fewer 
FTEs 

1,6= 

Company with more than 50 
FTEs 

Company with 50 or fewer 
FTEs 

1.6 

Company with more than 100 
FTEs 

Company with 100 or fewer 
FTEs 

1.39“ 

Company wth more than 500 
FTEs 

Company with 500 or fewer 
FTEs 

1.05 


®Nine companies did not indicate what percentage of their research and development they fund 
internaBy; therefore, they are not included in this calculation. 


'’FTE = full-time equivalent. 

“Nine companies did not provide their number of FTEs; therefore, they are not Included in this 
calculation. 

'’Because this odds ratio is close to 1 .00. we can say that the odds of a company with 1 00 or 
more FTEs continuing its project are about the same as the odds of one with fewer than 100 FTEs 
continuing its project. 


In addition, single applicants more often continued their projects than 
Joint-venture applicants: 58 percent (11 of 19) of the single applicants 
continued their projects, while only 33 percent (3 of 9) of the joint-venture 
applicants continued theirs. Seventy-one percent (5 of 7) of the companies 
that generally fund 50 percent or more of their research and development 
from their own internal company funds continued their projects. In 
contrast, 50 percent (6 of 12) of the companies that generally fund less 
than ^ percent of their research and development from their own internal 
company funds continued their projects. (Nine companies did not indicate 
what percentage of their research and development budgete they ftind 
internally.) 
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Finally, among the near winners, the smaller companies continued their 
projects somewhat less trequently than the larger companies.^ For 
example, 50 percent (3 of 6) of the near-wirmer companies with 50 or 
fewer full-time equivalents (fte)® continued their projects, while 
62 percent (8 of 13) of the near-winner companies with more than 50 ftes 
continued theirs. (Nine companies did not provide the number of ffes for 
their companies.) 


Some Near Wiimers Did 
Not Continue Their 
Projects 


Fourteen near winners did not continue their projects after atp declined to 
fund the projects. The reason they most often gave for not continuing was 
lack of funding (cited by 1 1 near winners). Two near winners indicated 
that their projects were too long-term; one cited market changes; one smd 
that the project was too risky; and one joint-venture near winner said that 
its newly formed partnership had not worked out. (The near winners could 
provide more than one reason.) 

Of the near winners that did not continue their projects, 64 percent (9 of 
14) searched for funding but did not find it. Eight of these nine reapplied 
for ATP funding during a subsequent round of competition. Six of the nine 
are no longer looking for ftmding to continue their projects. 


Status of Projects Funded atp funded 89 projects from 1990 to 1993, and 14 near winners carried out 

by ATP and Other Sources ^heir projects using other funding sources during this time. Sixty-four 

percent of these projects (66 of 103) were still under way at the time of our 
survey. Twenty-seven percent of the projects (28 of 103) had been 
completed, while 5 had been discontinued. The respondents to our survey 
listed the status of the four remaining projects as either suspended or 
delayed. When we asked ail the applicants that had carried out their 
projects how satisfied they were with either the projects’ technical 
direction and progress (for ongoing projects) or outcome (for completed 
projects), 94 percent (84 of 89) of the winners and 79 percent (11 of 14) of 
the near winners whose projects were funded by other sources indicated 
that they were at least generally satisfied. 


‘'Joint-venture ^plicants were not included in this comparison because they may include companies of 
different sizes. 

"Measures of FTE incUcate a company’s size by estimating how many full-time employees are 
represented by ali pait4Jme and fidl-time employees considered together. 
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B-27055I 

Conclusions 

According to the results of our survey, atp funds both projects that would 
have been funded in its absence and projects that would not have been 
funded. In addition, atp thieves other goals, such as aiding the formation 
of joint ventures and helping companies achieve research milestones 
faster. These results should be considered together when assessing atp’s 
impact. 

Agency Comments 
and Our Evaluation 

We provided a draft of this report to the Department of Commerce for 
comment. Commerce found much of the report to be well done but 
recommended certain changes. For example, Commerce felt that the 
report needed to highlight our survey’s results showing that those research 
projecte of near winners that were continued with alternative funding 
continued at a slower pace than planned. We have revised the report as 
appropriate. Commerce’s written comments, along with our detailed 
responses, are provided in appendix IV. 


We conducted our assessment from July 1994 through December 1995 in 
accordance with generally accepted government auditing standards. As 
arranged with your office, unless you publicly announce its contents 
earlier, we plan no further distribution of this report until 30 days after the 
date of this letter. At that time, we will send copies to the Secretary of 
Commerce; the Director, National Institute of Standards and Technology; 
the Director, atp; the Inspector General, Department of Commerce; the 
Director, Office of Management and Budget; and other interested parties. 
We will also make copies available to others on request. 

Please call me at (202) 512-3841 if you or your staff have any questions. 
Mzgor contributors to this report are listed in appendix V. 

Sincerely yours, 



Victor S. Rezendes 
Director, Energy and 
Science Issues 
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Appen di x I 

Profile Information for Single-Applicant 
Companies 


In our survey, we asked individual applicants for general information 
which, taken together, provides a profile of their companies. We used 
some of this information for the analysis summarized in table 1 of this 
report. We include here supplemental profile information that provides an 
overall picture of the coverage provided by the Advanced Technology 
Program (atp). This information includes the size of the companies based 
on the number of employees as well as on gross sales. We requested these 
figures for tfie fiscal year completed before the company applied to atp. 

We also asked for the year the company made its first sale as an indicator 
of the age of the applicant company. Included also are figures for the 
sources that each company relies on for its overall research budget. We 
again asked companies, in answering this question, to base their responses 
on the fiscal year completed before they applied to atp. 


Figure 1.1: Number of FutbTime 

Equivalent Employees, Including Both so Number of atp Applicants 

Outsourced and Permanent 

Employees 

40 


30 



FuH-Time Equivalents (FTEs) 
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Appendix I 

Profile Information fmr Sin^e-Applicant 
Companies 


Figure 1.2: Total Value of Gross Sales 
in Fiscal Year Before Company’s 
Application to ATP 


Number of A'H’ Apfriicants 


Qj 




Dollars 
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Appendix I 

Profile Information for Sin^e- Applicant 
Compani(» 


Figure i.3: Year of Company's First Sales 

Number of ATP Applicants 



Year 
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Appendix 1 

Profile Information fiw Sinf^e- Applicant 
Companies 


Figure i.4: Percentage of Company’s 

Direct Research and Development 100 Number of atp Applicants 

(R&D) Budget Provided by Federai 
Government Agencies 
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Percent Provided by Federal Sources 


Figure 1.5: Percentage of Company’s 

Direct R&D Budget Provided by State 100 Number of atp AMicanis 
Government Agencies 

90 



Percettt Provided by State Sources 
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Appendix I 

Profile Information for Single-Applicant 
Companies 


Figure 1.6; Percentage of Company's 

Direct R&D Budget Provided by 100 Number oi aip Appiicanu 

Venture Capitalists 
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Figure iJ: Percentage of Company’s 

Direct R&O Budget Provided Through 100 Number of atp Applicants 
R&D Contracts With Other Companies 
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Appendix 1 

Profile Informatkm for Sin^e-Applicant 
Companies 


Figure i.8: Percentage of Company's 
Direct R&D Budget Provided From 100 

Infernal Funding 
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Percent Provided by Internal Co. Funds 


Figure i.9: Percentage of Company's 

Direct R&D Budget Provided by 100 Number of atp Applicants 

Industry Groups or Trade Associations 
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Appendix I 

Pro^e Information for Si^e-Applicant 
Companies 


Figure 1.10: Percentage of Company’s 

Direct R&D Budget Provided by Other 100 Number erf AiiPAppiicanu 
Sources 

90 

80 
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Appendix II _ _ _ _ 

Survey Questions and Response 
Frequencies for Winners and Near Winners 
of ATP Awards 


Uniled Staia Gciwrai Accounting Office 

GA3 Survey of ATP Award Winners (Completed 

Questionnaire with Frequencies) 

INTRODUCTION 

3. In what year did diis company begin operations? 

The U.S. Genera] Accounting Office (GAOX an agency 

&_ 1803 to 1899 

that examines issues and programs for Congress, is 

7 1900 to 1929 

evaluating some of the impacts of the Advanced 


Technology Program (ATP). 



S 195310 1973 

If your proposal was submitted by a joint ventute, answer 

36 1974 to 1994 

in terms of your experience with the joint venlura's 

proposal, rather than with a panicipating compiuiy. We 
recogniae that joint ventures may separate various duties 

24 Missing 

atiKJog participating companies, but please answer the 
questions as best you can. 

4. In what year, if any, did the company ftrsc generate 
sales? 

If the prr^sal was submitted a single af^lkant, 
answer in terms of your experience with the company's 
proposal. By the company we mean die entire cotnputy 
(for small businesses), or the unit or division <3f the 

35 1985 orearlier 

1 1986 

2_ 1987 

company that submitted the ATP |m>pos^ (for large 

businesses). 

1 1988 

Note: These frequencies were (abolated after 


excluding eleven respondents; therefore, some t>f these 


statistics may not match those In the body of the 


report. See appendix DI for details. 

1 1992 

SECTION I: COMPANY BACKGROUND 

3 1993 

INFORNUTION 

3 1994 

1. How many ATP award winners? 

6_ Have not had any sales 

89 Winner 

23 Missing 

2. indicate type of application. 


23 Joint venture 


66 Single applicant 

1 


Page 19 


(JAO/RCED-96-47 Advanced Technology Program 



155 


Appendix il 

Survey Questioiu and Sesponse 
Frequencies for Wanexs and New Winners 
of ATP Awards 


5. How R)wyfuII*timeequivaleiU employees did yotif 
company have when you ai^lied to ATP? Include 
outsourced as well as pem»neni employees. 

37 0 to 100 

4^ lOi to 200 

5^ 201 to 300 

^ 301 to 400 

0^ 401 to 300 

16 Over 500 
25 Missing 

6 . In vdiat year did the member companies of the joint 
venture agree to pursue the proposal described in the 
ATP proposal? 

6_ 1990 

9_ 1991 

5 1992 

^ 1993 

66 Missing 

7. TAwhatycardidihe>}iMventureactuallybegin 
woridng on the projM? 

0_ 1985 or earlier 

0 1986 

0 1987 

0_ 1988 

0_ 1989 

2_ 1990 

£ 1991 

10 1992 

I 1993 

5 1994 

^ 1995 

0 N« started yet 

0_ Don't know 

66 Musing 


8. Did the joint venture come together as a new group to 
pursue the project described in the ATP pioposal, or 
was the joint venture already together working on it? 

Joint venture came together to pursue the ATP 

project 

2_ Joint venture was pursuing ATP project 

together, before ATP 

3_ Jwnt venture was pursuing Mher unrelated 

projects together, before ATP 
66 Missing 

9. What percentage of the company's DIRECT R&D 
budget was provided by /ederaJ government agencies 
? Base your answere on the last fiscal year 
complete before you applied to ATP. 

26 None 
17 ! to 20% 

1.0 21 lo40% 

4^ 41 to 60% 

7 61 to 100% 

25 Missing 

10. What percentage of the company’s DIRECT R&D 
budget was provided by slate government agtneitsl 
Base your answers on the last fiscal year completed 
before you applied to ATP. 

57 None 

6 Ho 20% 

l_ 21 to 40% 

0 41 to 60% 

0^ 61 to 100% 

25 Missing 
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Appendix li 

Survey Questions and Besponse 
Frequencies fur Winners and Near Winners 
of ATP Awards 


1 1 . What percentage the cMitpeny's DIRECT R&D 
budget was provided by Miistry gnmpt or trade 
associatioHs') Base your answers on the Iasi fiscal 
year completed before you relied to ATP. 

5B None 

6 1 to 20% 

0_ 21 to 40% 

0_ 41 to 60% 

0 6! to 100% 

25 Missing 

12. Whu percentage cd the company's DIRECT R&D 
budget was provided by other private eompaaUsf 
Base your answers on the last fiscal year completed 
before you applied to ATP. 

40 None 

13 1 to 20% 

^ 21 to 40% 

4_ 41 to 60% 

_ 161 to 100% 

?5 Missing 

13. What percentage of the ctxnpany's DIRECT R&D 
budget was provided by ivAtHrees^italistt? Base 
your answers on the last fiscal year completed before 
you applied to Al?. 

49 None 

3_ 1 to 20% 

1_ 21 to 40% 

I 41 to 60% 

_ 10 61 to 100% 

25 Missing 


14. What percentage of the con^any’s DIRECT R&D 
budget was provided by internal funding from 
company income! Base your answers on the last 
fiscal year completed before you applied to ATP. 

20 None 
10 I to 20% 

4 21 CO 40% 

2_ 41 to 60% 

28 61 to 100% 

25 Missing 

15. What odier/uKdiRgsoum; did you use? Base your 
answers on the last fiscal year completed before you 
applied to ATP. 

1 Banks 

^ CorpOTate investors, not venture capitalists 

^ High net worth individual 

_ 1 Internal funding from interest, dividends, gifts, 
etc. 

1 Licenses related to R&D contracts 

1 Owner's funds 

2 Private individuals, not venture capitalists 

Universities 
80 Missing 

SECTION 11: ATP PROPOSAL HISTORY 

16. Did you seek funding from other sources to pursue 
the project described in the ATP proposal BEFORE 
you sought funding from ATP? 

30 Yes 
58 No 

^ Don’t know 

0 Missing 
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Appendix U 

Survey Questi<»!s and Expense 
Frequencies for Winners and Neiu' Winners 
of ATP Awards 


■ 


17. How long did ywi seek Uiis funding? 

21. How many attempts did you make to obtain funding 

from state government agencies'! 

X3 Ota 12momhs 


0 None 

11 13 to 24 months 

4 Over 2S months 

2 1 to 2 attempts 

61 Missing 

0 3 to 4 attempts 

1 Over 4 attempts 

18. How many full-time equmknt persons were 

86 Missing 

assigned to help seek htnding for the projea during 

this period? Include outsourced as well as permanent 

22. How many attempts did you make to obtain funding 


from industry groups/trade associations'! 

28 0to5 

1 None 


6 1 to 2 mtempts 

60 Missing 

3 to 4 attempts 

19. Where did these persons seek funding? 

0 Over 4 attempts 
t9 Missing 

12 U5. Federal government agencies other than 


23. How many attempts did you make to obtain funding 

^ State govemmem agencies 

from other private companies? 

10 Industry groups/tntde associations 

0 None 

U R&D contracts with other private companies 

4 1 to 2 attempts 

9 Venture capitalists 

0 3 to 4 attempts 

9 Internal funding from company income 

10 Over 4 attempts 

2 Other 

75 Missing 

59 Missing 

20- How many attempts did you make to obtain funding 

24. How many attempts did you make to obtain funding 
from venture capitalists? 

from ftdtnl government ageneiest 

1 None 

0_ None 

2 I to 2 attempts 

5 1 to 2 attempts 

3 3 to 4 attempts 

4_ 3 to 4 attempts 

4 Over 4 attempts 

2 Over 4 attempts 

80 Missing 

_22_ Missing 

4 
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Appendix 21 

Survey Questions wad Sesponse 
Frequencies for Winners and Near Winners 
of AlP Avrards 


25. How many attemptsdid you roaketoobtain funding 
from internal /undlngfrom company income'! 

0^ None 

2 1 to 2 anempta 

3 3 to 4 wen^U 

4 Over 4 attempts 
ao Missing 

26. Were any of your attempts to obtain funding 
unsuccessfu! because you turned down funding that 
had terms or condidons you would not accept? 

3 Yes 

26 No 

^ Don’t know 

59 Missing 

n. When you submitted the ATP proposal, did you 
intend to pursue the project whetW or not you 
received ATP funding? 

29 Yes 

9_ Probably yes 

14 Uncertain 
n Probably no 
22 No 

28. Did you intend to pursue the project on the same 
schedule as described in the ATP proposal or on a 
modified schedule? If modified, when would the 
milestones be met? 

0 Sooner than in the ATP proposal 

2^ At the same lime as in the ATT pr<^>osa! 

34 Later than in the ATP proposal 
53 Missing 


29. Was the project described in the ATP proposal 
underway PRIOR to submission of the proposal to 
ATP? 

21 Yes 
68 No 

30. Wa.« the funding level of the on-going project less 
chan, about the same as, or higher than (he amount 
requested by ATP? 

19 Less than the ATP request 

^ About the same as the ATP request 

1 Higher than the ATP request 

68 Missing 

SECTION HI. PROJECT STATUS & PROJECT 

RESULTS 

31 . What is the status of the project described in the ATP 
proposal? 

55 Underway 
28 Completed 

^ Discontinued 

3 Other 

32. How satisfied, ifat all, are you with the technical 
direction and progress/outcome of the project? 

60 Very satisfied 
24 Generally satisfied 
0 Neither satisfied or dissatisfied 

1 Generally dissatisfied 

^ Very dissatisfied 

4 Don’t know 
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Appendix H 

Survey Questions and Sesponse 
Frequencies for Wtaners and Near Winners 
of ATP Awards 


33. Which aatemew BEST desoibes Ihe results you 
expected to have at the end of the [RC^ct at ^ dme 
you appibd to ATP? 

5S Project sold commercially 

^ Process used internally 

9 Product or {Nocess used by artotber firm whh 

compensation 

^ Product or process used by another firm 

without compensation 
^ Don't know 


34. When you applied to ATP. were you aware of other 
U.S. companies that were also cortducting technical 
work toward cAtjectives of the ATP proposal? 

59 Yes 
59 No 

1 Don’t know 


35. If you have any additional comments or information 
you would like to provide please do so in the space 
below. 


Thank you, ihii eoneludex ik* qatsiiomtain! 
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Appendix 11 

Survey Questions and Kesponse 
Frequencies for Winners fund Ne»r Winners 
of ATP Awards 




United States General AecouDtiof' Oflice 

Survey of ATP Award Near Winners 
(Completed Questionnaire with Frequencies) 

INTRODUCTION 

3. In what year did this company begin operations? 

The U.S. Oeneral Accounting Office (GAO), an agency 

2 I 803to 1899 

that examines issues and progfams f<K Congiess, is 

3 ]900tol929 

evaJuating s«iw of the impacts of the Advanced 


Technology ^gram (ATP). 

6 1953 to 1973 

If your proposal wa.s submitted by a joint venuire, answer 


in terms of your experience with the jmiit venture's 


proposal, rather than with a participating company. We 
recognize that joint ventures may separate various duties 

^ Missing 

among participating companies, but please answer the 

4. In what year, if any, did the con^»ny first generate 
sales? 

questions as best you can. 

If the pri^sai was submitted by a single applicant. 

12 1985 or earlier 

answer in terms of your experience with the company's 

proposal. By the company we mean the entire company 
(for small butinesses), or the unit or division of the 

0 1986 

0_ 1987 

con^any that submitted the ATP proposal (for large 

businesses). 

1 1988 

Note: These frequencies were tabulated after 


excluding eleven respondents; (herefore, some of these 


statistics may not match those In the body of the 


report See appendix III for details. 

2 1992 

SECTION I: COMPANY BACKGROUND 


INFORMATION 

1994 

1 . How many ATP award near winners? 

1995 


1 Have not had any sales 

2. Indicate type of ^plication 

9 Joint venture 

19 Single applicant 

i Missing 
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Appendix II 

Survey Questioi» and Besponse 
Frequencies ftir Wlnoras and Near Winners 
of ATP Awards 


5. How many fulUtime equivalent enqdojws did your 
company have when ytm iqij^Kd to AH*? bKlude 
outscHiTced as well as permanent employees. 

a^OtolOO 

0 lOl io200 

2 201 to 300 

0 301 to 400 

2 401 to 300 

1_ Over 500 

^ Missing 

6. In whatyeardidthemembercompaniesofthe joint 
venture agree to pursue the proposal described in the 
ATP proposal? 

2 1989 

1 1990 

2 199! 

^ 1992 

1993 

20 Missing 

7. Inwhatyeardidthejoinivcntureactuailybegm 
working on the project? 

]_ 1987 

l_ 1990 

l_ 1991 

I 1992 

Not Started yet 

'l_ Don't know 

19 Missing 


8. Did the joint venture come together as a new group to 
pursue the project described in the ATP proposal, or 
was the joint venture already together working on it? 

^ Joint venture came together to pursue the AIT* 

project 

Jmnt venture was pursuing ATP project 

together, before ATP 

2 Joint venture was pursuing other unrelated 

projects together, before ATP 
19 Missing 


9. What percentage of the company's DIRECT R&D 
budget was provided by federal government agencies 
? Base your answers on the last fiscal year 
completed before you applied to ATP. 

T_ None 

i to 20% 

2 21 to40% 

2 41 to 60% 

61 to 100% 

9 Missing 


10. What percentage of the company’s DIRECT R&D 
budget was provided by state government agencies? 
Base your answers on the last fiscal year completed 
before you applied to ATP, 

11 None 

0 1 to 20% 

2 21 to 40% 

0 41 to 60% 

0 61 to 100% 

9 Missing 


2 
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Appendix II 

Survey Questions and Besp<mse 
Frequencies for Winneis and Near Winners 
of ATP Awards 


1 1 . What percentage of the c(xnpwy'& DOtECT RAD 
budget was provided by indutaj groups or trade 
casacia^nsl Base your answers on the last fiscal 
year con^ieted before ym applied to ATP. 

13 None 

0^ 1 to 20% 

^21 to 40% 

0 4110 60% 

0 61 to 100% 

^ Missing 

12. What percentage of the company’s DIRECT RAD 
budget was provided by other private companies! 
Base your answers on the last fiscal year completed 
before you applied to AlP. 

13 None 

1_ I to 20% 

l_ 21 to 40% 

1_ 41 to 60% 

l_ 61 to 100% 

Missing 

13. What percentage ofthecon^tany's DIRECT RAD 
budget was provided by venture eapllaiists! Base 
your answers on the laM fiscal year completed before 
you allied to ATP. 

16 None 

^ 1 to 20% 

0 21 to40% 

0 41 to 60% 

2_ 61 to 100% 

9 Missing 


14. What percentage of the company’s DIRECT RAD 
budget was provided by internal funding from 
company! Base your answers on the last fiscal year 
completed before you applied to AlP. 

6 None 

i I to 20% 

Z_ 21 to 40% 

X_ 41 to 60% 

6 61 to 100% 

^ Missing 

15. What other funding sources did you use? Base your 
answers on (he last fiscal year completed before you 
applied to ATP. 

^ High net worth individual 

27 Missing 

SECTION Hi ATP PROPOSAL HISTTORY 

16. What reasons, if any, did ATP cite for declining your 
ATP award? 

15 insufficient business plan 

£_ Technology not preeompetilive/generie 

0 Technology posed too little risk 

5 Lack of available ATP fonding 

14 Other 
0 Don’t know 
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Appeadix II 

Survey Questions and Response 
Frequencies for Winners and Near Winners 
of ATP Awards 


1 7. What were Ac "other" reasons cited by ATP? 

21. Where did Aese persons seek funding? 

i ATP wants to sui^xnt congMmes not 

? U.S. Federal government agencies other than 

univenities in technology development 


pn^sals 

2 State government agencies 

^ Felt congiany did not have an adequate 

undentanding the chemistry of why dte 

^ Industry groupsAradc associations 

technology 

6 R&D contracts with other private companies 

1 John venture partners disagreed Oft direction 

5 Venture capitalists 

of project at last minute 

5 Internal funding from con^any income 

1 Lack of an adequate transfer plan 

2 Other 

1 Lack of experience team 

IS Missing 

1_ Limited experience in commercialization 

1 Matching funds 00 low side 

22. How many attempts did Aese persons make to obtain 

1 Not a viable invention 

funding from federal govemmeni agencies'! 

1 One member of joint venture widuhew 

0 None 

1 Sonte minor technic^ issues 

2 1 to 2 attempts 

2 Technical content was incomplete 

2 3 to 4 attempts 

1 Too little company commitment formoney 

2 Over 4 attempts 

1 Uncertain about meeting proposal objectives 

22 Missing 

18. Did you seek funding from other sources to pursue 

23. How many attempts did Aese persons make to obtain 

the project described in the ATP proposal BEFORE 
you sought funding from ATP? 

funding from state governotent agencies'! 





i5 No 

1 to 2 attempts 


0_ 3 to 4 attempts 

1 9. How long did you seek this funding? 

0 Over4auempis 

26 Missing 

6 Oto l2monAs 


13 to 24 monAs 

24. How many auempis did these persons make to obtain 

2 Over 23 months 

funding from industry groups/trade associadons'! 

26 Missing 

0 Norte 


0 1 to 2 attempts 

20. How many full-time equivalent persons were 

1 3 to 4 attempts 

assigned to help seek funding for the project doting 

Ais period? Include outsourced as well as permanent 

0 Over 4 attempts 

employees. 

2? Missing 

13 Oto5 


0 Over 5 


15 Missing 

4 
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25. How many tempts did these persons malx to obtain 
Tuning from other private eompaoiei'! 

0 Nwe 

1 to 2 anempts 

^ 3 to 4 attenqxs 

5^ Over4atlefnpts 

20 Missing 

26. How many aRempts did these posons make to i^tun 
funding from venture eripitoHsts'! 

0_ None 

^ 1 to 2 anempl.s 

^ 3 to 4 anempts 

^ Over 4 attempts 

24 Missing 

27. How many attempts did these persons make to obtain 
funding from intemol funding from company 
income'! 

0 None 

4_ 1 to 2 altcmpls 

0 3 to 4 anempts 

2. ^ attempts 

24 Missing 

28. Were any of your anempts to obtain funding 
unsoccesstul because you turned down funding that 
had terms or conditions you would not accept? 

Yes 

10 No 
15 Missing 


29. When you submitted the ATP proposal, did you 
intend to pureue die project whether or not you 
received ATP funding? 

13 Yes 

Piobably yes 

£ Uncertain 

2_ Probably no 

8^ No 

30. Did you intend to pursue the projetR on the same 
schedule as described in the ATP proposal tx on a 
modified schedule? If modified, when would the 
milestones be met? 

0^ SoofKr than in the ATP proposal 

0 At the game time as in the ATP proposal 

13 Later than in the ATP proposal 
^ Don't know 

Missing 

31. Was the project described in the ATP proposal 
underway PRIOR to submission of the proposal to 
ATP? 

14 Yet 

13 No 

l_ Don’t know 

32. Was the funding level of the on-going project less 
than, about the same as, or higher than the amount 
requested by ATP? 

11 Less than the ATP request 

2^ About the same as the A'TP request 

1 Higher than the ATP request 

14 Missing 
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33. What percentage of the funding forthe oRgoing 

37. What percentage of the funding few the ongoing 

project was provided by ftdtral government agenem 

project was provided by venture capitalists'? 


12 None 

9 None 

0 1 to 20% 

0 1 to 20% 

1 21 to 40% 

21 to40% 

0 4lto60% 

41 to 60% 

1 6! to 100% 

3_ 61 to 100% 

14 Missing 

14 Missing 

38. What percentage of the funding for the ongoing 

34. What percentage of the funding fix the ongoing 

project was provided by internal funding from 

project was provided by sfategayemMen/age/KKS? 

company income'? 

10 None 

4 None 

3 1 to 20% 

2 1 to 20% 

1 21 to 40% 

2 21 to 40% 

0 41 lo60% 

0 41 to 60% 

0 61 to 100% 

61 to 100% 

14 Mis.sing 

14 Missing 

33. What percentage of the funding for the ongoing 

SECTION HI. PROJECT STATUS* PROJECT 

project was provided by imlust/y group* or tmde 
assecituioiul 

RESULTS 

14 None 

39. We understand that you were declined an ATP 

award. Since then, have you begun the project 

0 1 to 20% 

described in the ATP proposal? 

0 2! to 40% 

14 Yes 

0 41 U)60% 

14 No 

0 61 to 100% 


14 Missing 

40. Is the project's schedule the same as described in the 


ATP proposal, or is it modified? If modified, when 

36. What percentage of the funding for the ongoing 


project was provided by other pnvott eompmiesJ 

0^ Sooner than in «he ATP proposal 

12 None 

^ At the same lime as in the ATP proposal 

1 1 to 20% 

13 Later than in the ATP proposal 

0 2J(o40% 

14 Missing 

0 41 to 60% 


1 61 to 100% 


14 Missing 

6 
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of ATP Awards 


41. WhMperc(»U^ec^(befaitdingfwcbe[«oject 
described in the ATP propc^l, on which you ate now 
wo-king is being provided by /edrralgovernme/M 
dfenetes? 

9 None 

0 1 to 20% 

0 21 W 40% 

^4Ho60% 

^ 61 to 100% 

la Missing 

42. What percentage of the fuitding forthe project 
described in the ATP proposal, tm which you are now 
working is beirtg provided by subfegaenr 
comp*ti/ion round htld by A TPl 

0 None 

0 ] to 20% 

0 21 to 40% 

0 41 to 60% 

0 61 to 100% 

14 Missing 

43. What percentage of the funding for (he project 
described in the ATP proposal, on which you are now 
woriciflg is being provided by steSegoivraMent 
<tgenei«s? 

11 None 

1 1 to 20% 

0 21 to 40% 

0 41 to 60% 

0 61 to 100% 

14 Missing 


44. What percentage of the funding for the project 
described in the ATP proposal, on which you kc now 
working is being provided by industry groups or 
trade associations'! 

11 None 

!_ I to 20% 

1 21 to 40% 

0 41 to 60% 

X_ 61 to 100% 

14 Missing 

45. What percentage of the funding for the project 
described in the ATP proposal, on which you are now 
working is being provided by other private 
companies’! 

12 None 

_ _1 1 to 20% 

^ 21 to40% 

0 41 (o60% 

1_ 61 to 100% 

14 Missing 

46. What percentage of the binding for the project 
described in the ATP proposal, on which you are now 
working is being provided by venture cqpita/iifa? 

12 None 

0 1 to 20% 

1 21to40% 

0_ 41 to 60% 

l_ 61 to 100% 

14 Missing 


7 
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47. What percentage of the fumfing fw the project 

described in the ATP «» udiidi you are now 

wodcing is being provided by inUnud funding from 
company income'} 

^ Nw)e 

0 1 to 20* 

2 21 to 40% 

2 41 to 60% 

4 61 to 100% 

14 Missing 

48. How long did you lod: for funding after the ATP 
proposal was declined? If you looked for funding 
while the ATP proposal was under review, also 
include that time irt your ansvrer. 

^ Did not look for binding after being declined 

27 Missing 

49. Where did you look for funding to continue or begin 
the project described in the proposal befi»e you 
found funding? 

7 U.S. Federal government agencies Other than 
ATP 

S Subsequent competition round held by ATP 

^ State government agencies 

^ Industry groups/ttade associations 

4^ RAD contracts with other private con^anies 

4_ Venture capitalists 

1 Internal funding from con^ny income 

0 Olher 

14 Missing 

50. How many attempts did you make to obtain funding 
from federal government agencies'} 

0_ None 

^ J to 2 attempts 

^ 3 to 4 attempts 

2^ Over 4 attempts 

21 Missing 


51. How many attempts did you make to obtain funding 
from subsequent competition round held by ATP? 

0^ None 

^ 1 to 2 «iempts 

^ 3 to 4 ^tempts 

0_ Over 4 attempts 

23 Missing 

52. How many attempts did you make to obtain funding 
from slate government agencies? 

0 None 

^ I to 2 attempts 

^ 3 to 4 attempts 

Ovcr4 attempts 
27 Missing 

53. How many attempts did you make to obtain funding 
from industry groups/trade associations? 

0 None 

2_ } to 2 auempts 

0 3 to 4 attempts 

0 Over 4 attempts 

26 Missing 

54. How many attempts did you make to obtain funding 
from other private companies? 

0 None 

2 i to 2 attempts 

0 3 to 4 attempts 

1_ Over 4 attempts 

2S Mis.sing 
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of ATP Awards 


55. How many auempts did you make to obtain funding 
from ventun eapiialists'} 

0 None 

0^ 1 to 2 wempts 

2 3 to 4 anempts 

0^ Over 4 attempts 

25 Missing 

56. How many attempts did you make to obtain funding 
from inumal funding from company incomtl 

0 None 

1 to 2 attempts 

0 3 W 4 aiiempis 

0 Over 4 attempts 

27 Missing 

57. Were any of your attempts to obtain funding 
unsucce»ful because you turned down funding that 
had terms or conditions you would not accept? 

0 Yes 

10 No 

IB Missing 

5S. What is the status of the project described in the ATP 
proposal? 

11 Underway 

0 Completed 

2 Discontinued 

I Other 

H Missing 


59. How satisfied, if at all, are you with the technical 
direction and progress/outcome of the project? 

^ Very satisfied 

2_ Generally satisfied 

0_ Neither satisfitid or dissatisfied 

^ Generally dissatisfied 

0_ Very dissatisfied 

14 Missing 

60. Which statement BEST describes the results you 
expected to have at the end of the project at the time 
you applied to ATP? 

Project sold commercially 

^ Process used internally 

^ Product or process used by another firm with 
compensation 

0_ Product or process used by another firm 

" without compensation 

1_ Don't know 

14 Missing 

61. When you applied to ATP. were you aware of other 
U.S. companies that were also conducting technical 
work toward objectives of the ATP proposal? 

6 Yes 

S_ No 

14 Missing 

62. Have you attempted to obtain funding from sources 
other than ATP, or from ATP in a subsequent 
competition round, to CONTINUE/BBGIN the 
project described in the ATP proposal? 

9 Yes 


__i No 
3 Don’t know 
14 Missing 
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53. Where did you look for fundiRf to cmtiime « begin 
the project described hi the proposal before you 
found funding? 

_2 U.S. Federal goventmeni agencies Other (ban 
“ “ ATP 

8 Subsequent ccsnp«itk»a round held by ATP 

0 State goventment agencies 

Industry groups/lrade associations 

^ R&D ccKitracts with othtu private companies 

0 Venture capitalists 

0 Iniernat funding from company incrnne 

0 Other 

19 Missing 

64. How many attempu did you make to obtain funding 
from feiUnl government agencietl 

0 None 

^ I to 2 attempts 

1 3 to 4 attempts 

0 Over 4 attempts 

28 Missing 

65. How many attempts did you make to obthin funding 
from subsequent competition round held by ATP1 

0 None 

8 i to 2 attempts 

0 3 to 4 attempts 

0 Over 4 attempts 

20 Missing 

66. How many attempts did you make to c^xain funding 
from state government agencies! 

0 None 

0 1 to 2 attempts 

0 3 to 4 attempts 

0 Over 4 attempts 

28 Missing 


67. How many attempts did you make to obtain funding 
from industry groups/trade asiociatw»M? 

^ None 

^ 1 to 2 attempts 

0 3 to 4 attempts 

0_ Over4 attempts 

28 Missing 

68. How many attempts did you make to obtain funding 
from other private companies! 

^ None 

^ 1 to 2 attempts 

0^ 3 to 4 attempts 

^ Over 4 attempts 

26 Missing 

69. How many attempts did you make to obtain funding 
from venture capilatisis! 

0_ None 

0_ I to 2 attempts 

0 3 (0 4 attempts 

2. * attempts 

28 Missing 

70. How many attempts did you make to obtain funding 
from internal funding from company income? 

0_ None 

0_ 1 to 2 attempt.? 

0_ 3 to 4 attempts 

0^ Over 4 auempts 

28 Missing 


10 
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Survey Questions and B^ponse 
Frequencies ft>r Winners M>d New Winners 
of ATP Awards 


71 . Were any of your attends to olaain funding 
unsuccessful because you turned down funding that 
had teitns or conditions you would not accept'! 

0 Yes 

9 No 

19 Missing 

72. Are you slil! pursuing funding for the project? 

Yea 

6 No 

19 Missing 

73. How long have you been seeking/did you seek 
funding sirtce (he ATP prt^tosal was declined? 

4 0 (0 12 months 

^ !3 to 24 months 

2 Over 25 months 

19 Missing 

74. How many full-time equiv^ent persons were 
assigned to help seek funding during this period? 
Include outsourced as well as permanent employees. 

0_ 0to5 

1_ Over 5 

19 Missing 

75. \Vhe(i you applied to ATP. were you aware of other 
U.S. companies that were also conducting technical 
work toward objectives of the ATP proposal? 

1 Yes 

6 No 

1 Don’t know 

14 Missing 


76. If you have aiy additional comments or information 
you would like to provide please do so in the space 
below. 


Thank you, this concludes the questionnaire! 


il 
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Ap pendix II I 

Objectives, Scope, and Methodology 


The objective of this report was to examine whether funds from atp are 
used to support research projects that would not have been funded by the 
private sector, or if it replaces private funds that would have otherwise 
been available. To meet this objective, we requested from atp a rank-order 
listing of all the applicants that received a score from the Source 
Evaluation Board^ for their atp proposal during the program’s first four 
rounds of competition (1990-93). 

In the first four rounds of competition, the Source Evaluation Board gave 
scores only to proposals that had been determined to have “very high” 
scientific and technical merit and that had passed a screening stage in 
which it was determined that the proposals satisfied the program's 
requirements. The Source Evaluation Board then assigned a score to all of 
the proposals on the basis of a business review and all the criteria 
contained in Conunerce’s regulations. According to atp officials, on the 
basis of this score, the proposals with strong technical and business merit 
were ranked and recorded on a list before the final oral review stage, atp 
provided that list to us. Using this list, we identified those that received atp 
awards as “winners” and those that did not receive atp funding as “near 
winners.” 

In our first primary research question, we asked the near winners if they 
had continued their proposed projects using other funding sources after 
ATP declined to fund them. We developed this question to shed light on 
whether atp winners (given their similarity to the near winners) would 
have continued their projects using other funding sources if atp funding 
had not been provided. In our second primary research question, we asked 
the winners and near winners if they had sought funding from otber 
sources before applying to atp. This question provided information on 
whether private-sector sources had the opportunity to fund the proposed 
projects before the ^plicants sought federal funding. 

Our work was structured in three phases. First, we interviewed atp 
officials, winners, and near winners to increase our understanding of atp’s 
review process and the applicants’ experiences with it. We spoke with 
representatives of other research and development (r&d) funding sources, 
such as the National Venture Capital Association. We also reviewed the 


*For each competition, ATP forms a Source Evaluation Board to rank the propo-saJs. A typical board 
consists of about a dozen senior-level manners from the National Institute of Standards and 
Technology (NIST)? supplemented with additional technical consultants from NIST and other federal 
labor^ries- The board members* bact^rounds vary widely. The board may include, for example, an 
electrical engineer, a chemist, a biotechnologist, a materials scientist, a computer scientist, and others 
with business and economics expertise. 
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Objectives, Scope, and Methodology 


relevant economic, policy, and evaluation literature and consulted with 
outside experts on the overall design of our assessment. 

Next, we designed a computer-mded telephone interview in which we 
requested several pieces of information from each applicant.^ Specifically, 
we asked questions on (1) the applicant's general characteristics, such as 
the size of the company and its sources of r&d funding; (2) the history of 
the project put forth in the atp proposal, such as whether the project was 
under way before the applicant requested funding from atp; and (3) the 
project’s status (for winners and near winners that continued their 
projects using other funding sources). We got expert review of a 
preliminary version of the questions from knowledgeable consultants. 

To t€St the validity of the questions, we pretested a draft survey 
instrument with three ATP award winners and four near winners. We 
selected them using the following factors: the round of competition in 
which the application was submitted, geographic location, type of 
applicant (single company applicant or joint venture), company’s size, 
proposal technology area, and award status (award winner or near 
winner). We conducted the first three pretests in person in Gaithersburg, 
Maryland and Somerset, New Jersey; we conducted the remaining four by 
telephone with winners and near winners located in Ann Arbor and 
Auburn Hills, Michigan, and San Jose and Menlo Park, California. On the 
basis of the comments and reactions from the experts’ review and our 
pretests, we revised ibe telephone interview questions so that they would 
be uniformly interpreted and understood. 

In the final phase of our work, we conducted telephone interviews with all 
the applicants that qualified as winners or near winners during atp’s first 
four rounds of competition, a total of 128 (89 winners and 39 near 
winners). Our survey achieved a 100-percent response rate. In our findings 
for both research questions, we excluded 6 near winners, reducing our 
total number of respondents to 123. We did this because these five near 
winners indicated that atp had disqualified them late in the review process 
because new information indicated that their proposals did not satisfy the 
program’s basic requirements. For example, in one instance atp decided 
that the applicant would do the project without atp funding and in another 
ATP decided that the project did not focus on precompetitive or generic 
research. In our findings for the second research question only, our total 
of near winners drops to 28 because 6 near winners eventually received 


comjwter was progranuned to skip qoe^ons that were irrelo%'anl to the individual respondent. 
For example, those involved in joint venture were not asked for the year of their first sale. In these 
cases, the computer tabulated the results as a missing response. See app. II, 
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ATP funding in a subsequent round of competition, eliminating them from 
our consideration because we focused only on near winners that found 
binding from sources other than atp. 

To examine how certain characteristics affect whether the near winners 
continued their projects, we calculated “odds ratios.” Odds ratios measure 
the association between two variables. The closer the odds ratio to 1.00, 
the weaker the association; the further from 1.00, the stronger.^ To 
illustrate, table III.1 reports the number of joint-venture and 
single-applicant near winners that did and did not continue their project 
after atp declined to fund them. 


Table ilf.1 : Number of Joint-Venture 
and Single-Applicant Near Winners 
That Continued Their Projects After 
ATP Declined to Fund 



Joint ventures 

Single applicants 

Continued 

3 

11 

Did not continue 

6 

8 


The odds ratio is calculated through cross multiplication and 
division — (1 1x6) divided by (3x8) — for a value of 2.75. Rounding to 3, we 
interpret this odds ratio to mean that single-applicant near winners were 
about three times more likely than joint-venture near winners to continue 
projects after atp declined to fund them. 


®For mra-e detail on the theory underlying odds ratios and their caicul^on, see William Page, 
■'InterpretatiOT of Goodman's Log-Linear Mode! Effects; An Odds Ratio Approach,” Sociological 
Methods & Resear ch, VoL S, No. 4, May 1977. 
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Appen di x IV 

Comments FYom the Department of 
Commerce 


Note; GAO comments 
supplementing those in the 
report text appear at the 
end of this appendix. 




Hr. Victor S. Rczendes 
Director, Energy and Science Issues 
Resources, CoBuounity, and Economic 
Development Division 
U.S. General Accounting offices 
Washington. D.C. 20548 

Dear Mr. Rezendes: 

We appreciate the opportunity to comment on the draft 
report, Performance Measurement: The Advanced Technology Program 
and Private Sector Funding, {GAO/RCEO-96-47, Code 307723). We 
note that the General Accounting Office (CAO) has not allowed us 
the usual 30 days to provide comments on this draft report. Our 
comments are enclosed. 

Some of the concerns noted in the enclosure are sufficiently 
Important that unless they are taken into account by GAO before 
the report is finalized, we believe the report’s conclusions 
would be potentially misleading at best and erroneous at worst. 
Much of the report is well-done; and so, if our recommendations 
are taken into account conscientiously, this could be a valuable 
and generally accurate report. 

If your staff requires additional information about the 
Department’s response to your report, they may contact the 
Advanced Technology Program’s Senior Economist, Rosalie Ruegg, at 
(301) 975-6135. 

Sincerely, 


Enclosure 


Ronald H. Brown f\ 
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Comments From the Depairtment of 
Commerce 


See comment 1 , 


Deceiaber 14, 1995 


Department of CoTBmerce (DOC) Comments on GAO Draft Report 
Measuring Perf ormance .* The Advanced Technology Program 

our most important concern is that in stating the conclusion, GAO 
must not bury in the text of the report critical caveats that 
might be overlooked the casual reader. These caveats are 
critically important to the conclusions that readers may draw, 
with these caveats, readers will correctly interpret the GAO's 
findings, without them, readers will likely draw invalid 
conclusions. 

The GAO’s survey results support the conclusion that the ATP is 
meeting its objective of funding projects that either would not 
be pursued at all or projects that would have been pursued 
without ATP funding, but at a much slower pace. 

- Of the respondents who said they intended to pursue the 
project whether or not they received ATP funding, nearly all 
indicated that without the ATP award their milestones would 
be met later than those set forth in the proposal. 

• The remainder of those who responded (other than 
“uncertain) indicated that they would have been unlikely to 
pursue the research at all without the ATP. 

- The fact that some of the near winners were able 
subsequently to obtain funding is perfectly consistent with 
ATP's decision not to fund then. If we believe that an 
applicant does not need ATP funds to pursue the project, we 
do not fund them. (One of our selection criteria is “Degree 
to which ATP support is necessary." ) 

- The fact that the scale of on-going research was expanded 
by the ATP award is consistent with ATP’s goal. 

- The fact that a higher percentage of ATP awardees 
indicated satisfaction with the technical direction and 
progress/outcome of their project than the near winners 
continuing may indicate that those continuing without ATP 
were not able to pursue the full project. 

- As GAO correctly concludes, the survey results indicate 
that the ATP euccessfully Costers joint research ventures. 
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Commerce 


See comment 2. 


Because it decouples the results of two appropriately coupled 
questions, the GAO's first statement on pages 3 and 11 is 
misleading, and needs to be corrected. 

- Our experience has been that if companies are asked, 

"Would you have pursued the project without ATP funding?” 
there is a very high potential for multiple interpretations 
of the question. At one extreme, some companies assume they 
are being asked whether without ATP funds they would have 
continued any amount of work at all in the general subject 
area of the proposal. Others may assume they are being 
asked whether the precise project would have been pursued 
with no changes. Still others will take an interpretation 
somewhere between these two extremes. For this reason, we 
have found that the more meaningful question to ask in this 
regard is, 

“Without ATP cost-sharing, how would your R&D in this 
specific area have differed with regard to schedule, 
scope of project, riskiness of technical and business 
goals, collaborations, etc.?'' 

- The GAO appropriately asked a follow-on question about 
whether the project schedule would have been different 
without the ATP, but unfortunately, it failed to include the 
other important ways a project can be altered — e.g., 
scope, scale, and riskiness of goals -- in the follow-on 
question. And, according to two other third-party surveys, 
if given the chance, the companies would also have indicated 
a smaller-sized effort, less ambitious research goals, 
and/or a less comprehensive project without the ATP award. 

- More importantly, the GAO failed to report in its summary 
of results and conclusions, the results of the follow-on 
question that revealed that nearly all of those who said 
they planned to pursue the research without ATP, said that 
the research schedule would be slower without ATP. 

(However, the GAO did correctly report in part on the bottom 
of page 5 the results of the paired questions, and that 
information deserves to be highlighted more.) 

To address these concerns, we strongly urge the GAO to change the 
first paragraph of the executive summary section titled “Results 
in Brief” on page 3 and the “Conclusions” section on page 11 to 
read along the lines of the following. (This wording is fully 
consistent with the caveats noted on page 5 of the GAO report.) 

ATP funds research projects that either would not have been 
funded at all without the ATP, or would likely have been 
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See comment 3. 


See comment 4. 


funded by others but at a slower pace and/or with less 
ambitious and less risky goals. Nearly all of those who 
said they would have pursued their project to some extant 
without ATP cost sharing indicated that the project schedule 
would have been modified without ATP cost sharing and that 
milestones would be met later than those set forth in the 
proposal to ATP. The survey questions did not ask whether, 
in such cases, the technical goals would also have been less 
ambitious and less risky without ATP cost sharing, but other 
surveys carried out by ATP to which we had access indicate 
that this also might be so in many cases. 

- We also urge that the report state clearly that 
accelerating the pace of research is but one of the ways 
that the ATP funding may alter those projects that might 
have been pursued without ATP. 

Were these recommended changes to be made, we believe the GAO 
survey can provide useful insight into the differences between 
the winners and near winners of ATP awards. 

Paragraph l of page 1 of the report states that the ATP funding 
for FY95 was $431 million. That is incorrect. Because of 
the $90 million rescission, the actual funding for F’V9? was 
$341 million. 
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GAO’s Comments 


The following are gao’s comments on the Department of Commerce’s 
letter dated December 21, 1996. 

1. While our draft Conclusions section referred to the pace of research 
projects, we have added a sentence to our report’s Resuits-in-Brief on this 
point. In our opinion, however, Commerce’s overall conclusion based on 
our survey results overlook a number of significant points. First, although 
ATP appears to enable applicants to complete their research projects faster, 
companies still find it worthwhile to pursue the projects, although on a 
slower schedule, without atp funds. Second, when asked, “What reasons, if 
any, did atp cite for declining your atp award?,” only one applicant said 
that atp had decided the project would be done without atp funding. 
(Subsequently, that project did not find funding elsewhere.) Third, while 
our survey results do indicate that a higher percentage of atp awardees 
indicated satisfaction with the technical direction and progress/outcome 
of their projects than the near winners, nothing in our survey supports 
Commerce’s conclusion about what those results indicate. 

2. Our draft Conclusions section referred to the pace of continued 
research projects, and we have added a sentence to our Results-in-Brief 
section on this point. While Commerce is concerned with multiple 
interpretations of one of our survey questions, we reduced the potential 
for multiple interpretations by instructing our interviewers to say 
specifically, “I’ll be asking you several questions about the history and 
status of ’the project described in your atp proposal,’ which I’ll sometimes 
refer to as ’the project.’ By fius we mean a project that you consider to be 
essentially the same as the one in the proposal.” If further clarification was 
needed, the interviewer would add, “To be ’essentially the same project,’ it 
should focus on the same technical work as the one in the atp proposal.” 

We used this wording to allow the respondent to rely on his or her own 
judgment in determining if the work that had continued was still the same 
project— despite changes in scope, schedule, and riskiness, among other 
things — or if in the respondent’s judgment, changes have resulted in a 
different project altogether. At a minimum, the project had to include the 
same technical work, even though, for example, some intended 
commercial applications of the work had changed. 

3. As noted in comments 1 and 2, we feel that Commerce’s conclusion 
overiool« a number of significant points based on our survey results. 

4. We have made the suggested change. 
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ATP Response to Senator Leviii’s Inquiry, May 2005 
ATP: Delivering Results 


Overview 

The Advanced Technology Program is a public-private partnership designed by Congress 
to encourage companies to develop innovative and high-risk technologies for broad 
national benefit. ATP’s bottom line is broad benefits for the nation - economic growth 
and better quality of life - rooted in innovative enabling technologies. In specific, this 
industry/govemment partnership has fostered benefits that extend well beyond the 
companies involved in the project; technologies with broad potential applications, 
particularly across different industrial sectors; and path-breaking technologies that open 
up new potential markets or make possible wholly new products or industrial processes. 
The Program’s results have been impressive. The Nation’s S2.3B investment has 
catalyzed an additional $2. IB of private investment. The projected returns for the 
American people from just a small portion of ATP projects far exceed the taxpayer 
dollars invested. Forty-one studied projects, just 6 percent of the ATP portfolio, have 
returned estimated economic benefits exceeding $17B: 


Economic Benefits of 41 Selected ATP Pro jects in 10 Studies 

Tissue Engineering 

$10,90B 

Data Storage 

3.00B 

Flow Control Machining 

1.15B 

Advanced Composites 

l.OOB 

Component Based Software 

0.80B 

Refrigeration 

0.45B 

2mm Auto Body Consortium 

0.20B 

Mammography 

0.20B 

HDTV Technologies 

0.1 3B 

Printed Wiring Board 

0.04B 

Combined Net Economic Benefits 

S17.87B 


Private Capital Markets have Failed to Provide Sufficient Funds for Enabling 
Technology Development 

Even with large amounts of capital available for investment (the U.S. Venture Capital 
Industry was estimated to be at about SlOB in 2004), the types of technology funded by 
ATP are not readily funded by this sector: 

• Venture capitalists typically fund businesses that are already engaged in later 
stage business activities and well into product development. According to 
Branscomb and Auerswald’, only seed financing rounds by venture capitalists are 
dedicated to early-stage technology development. 

• VentureSource data for 2001-2004 summarized show that in 2004 only $105 
million out of a total of $20 billion in VC investments (about one half of one 


Branscomb and Auerswald, “Between Invention and Innovation” (2002) 
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percent of VC investments), fund the type of technology development funded by 
ATP. 

A TP Investments Impact All Sectors of the Economy 

ATP Investments deliver results in all sectors of the economy: 

Transportation: 

• ATP investments have applications in the airline, automobile, pipeline, highway, 
trucking, maritime, and railroad industries. For example, one ATP project 
developed a new way to manufacture composite structures to be used in bridges 
and other infrastructure applications because they are lightweight and resistant to 
rust and corrosion. Decreased installation and maintenance costs are expected to 
be among the major benefits of using composite structural shapes in infrastructure 
rebuilding. 

• One recently-funded project will combine vision and radar sensor technology to 
create a new type of auto safety system that will detect approaching hazards, 
measure their rate of motion, determine if and where a collision will occur, and 
trigger mitigating actions, such as applying brakes, pre-tensioning seat belts, and 
firing side airbags, with a near-zero false alarm rate. 

Healthcare: 

• ATP is saving the lives of cancer patients and reducing their pain. For example, a 
desktop-size, first-of-its-kind, bioreactor grows stem cells and produces clinically 
useful quantities of cells from small amounts of bone marrow and umbilical cord 
blood and is useful for a broad range of cellular therapies. 

• ATP is making the future detection of breast cancer more affordable for routine 
use. For example, ATP enabled a next generation, all-digital mammography 
system that will produce fast and accurate mammograms at lower cost and make 
routine use more affordable. 

• ATP is improving orthopedic care. For example, a new bioabsorbable polymer 
derived from tyrosine for medical implants does not adversely affect tissue or 
bone or emit toxic substances when it degrades and eliminates the need for a 
second surgical removal. 

Telemedicine 

• ATP is turning telemedicine into reality and making healthcare more accessible to 
rural populations. For example, new technology gives rural patients access to a 
board certified radiologist 24 hours a day, 7 days a week, and, reduced time to 
transmit and interpret radiology reports from 10 hours to 15 minutes; and, reduced 
the number of transfers and repeat exams. 

Homeland Security 

• ATP’s investment in homeland security-related projects covers all critical areas: 
Critical Physical Infrastructure, Surveillance and Intelligence, Technologies for 
Incident Response, Biometrics, Chemical/Biological/Radiological/Nuclear 
Exposure, and Critical Infi-astructure Protection/Cyber Security. One project, for 
example, is developing large-area digital X-ray inspection systems with 
heretofore-unavailable accuracy for near error-free screening of cargo and sealed 
container freight at airports, seaports, and other points of entry. 
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Funds Needed to Restore ATP in FY2006 

To continue its work, ATP would need $150 million in FY2006. This would include 
$60.7 million for new awards, funding of FY 2006 mortgages resulting from all prior- 
year awards, and intramural fimding of $13.3 million for the NIST Laboratories. This is 
important for the following reasons; 

• Seizing the technological high ground is key to U.S. manufacturing competitiveness. 

o Full restoration of ATP is needed to help the United States transform 

manufacturing with highly efficient value-added processes thereby buttressing 
against the loss of traditional manufacturing jobs in the U.S., resulting in-part 
from the lower foreign labor costs. 

o Investing in technologies that have the potential to spawn many new 

industries, and create and sustain high-quality jobs, will provide widespread 
economic benefit in the coming decades. 

o Three out of four of the small companies in the first 100 completed projects 
have doubled in size since ATP funding. 

• Funding ATP research has and will continue to result in award-winning technological 
advances impacting entire industries and helping to address some of the Nation’s 
most pressing national needs in areas such as healthcare, energy, environment, and 
homeland security. 



183 



6252 Preston A v e . , Livermore, C A 94 5 5 1 

18 3 Northpointe B Iv d . , Suite 7 00, Freeport, PA 1 6 2 29 


May 20, 2005 

The Hon. Thomas Carper 
Member, Committee on Homeland 
Security and Government Affairs 
United States Senate 
Washington, DC 20510 

Dear Sen. Carper and Sen. Levin, 


The Hon. Carl Levin 
Member, Committee on Homeland 
Security and Government Affairs 
United States Senate 
Washington, DC 20510 


As an entrepreneur and founder of a high-tech start-up I want to thank you for your 
support for the Advanced Technology Program (ATP) and for your efforts to speak on 
the program’s behalf at the upcoming Subcommittee on Federal Financial Management, 
Government Information, and International Security oversight hearing entitled, "An 
Assessment of Federal Funding for Private Research and Development.". My company, 
RAPT Industries, was a recipient of an ATP award (2003-2005). RAPT is developing a 
revolutionary new process for manufacturing precision optics, ATP has played a critical 
role in our success, funding our technology development when NO OTHER source of 
commercial funding was available. 


As you know, the ATP has supported the development and commercialization of new 
technologies through a system of highly competitive grants, 3/4ths of which go to small 
businesses. The program has always had its critics, principally within the community of 
libertarian economists whose complaints run the gambit from “corporate welfare” to 
“unnecessary intrusion of the government in the private sector”. 

It is easy to understand their scorn. If you work in a think tank inside the Beltway, the 
landscape of technology commercialization in the United States probably looks quite 
simple. Markets function with perfect efficiency, new technologies are recognized while 
in the laboratory, and commercialization is funded by large corporations or by heroic 
venture capitalists with a vision for the economy of the future. From this perspective, 
ATP has no place. 

However outside the Beltway things are not so simple. The United States is blessed with 
the most prolific and productive R&D base anywhere in history. However a shocking 
number of new innovations DO NOT SEE THE LIGHT OF COMMERCIALIZATION 
FOR YEARS - mostly because the chasm that exists between science and technology as 
it is developed in the nation’s universities, government laboratories and corporate R&D 
centers, and the frontier of commercialization and business creation. 


Crossing this chasm is the most challenging and risky stage for the growth of a new 
company and a new industry. Ironically, this chasm does not efficiently winnow the few 
good ideas from the pack. Rather, crossing the chasm is mostly a function of luck, with 
money and perseverance also required. As one seasoned entrepreneur told me: very few 
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companies die because of their technology, most die because they don’t have the money 
to get to the other side of the chasm. 

As a scientist, entrepreneur and founder of a small technology company that has received 
funding from private investors, government grants and the ATP, the reality on the ground 
is not as tidy as the think-tank economists would have you believe. Private sector 
investment in technology commercialization has a mixed record: only 1 in 10 venture- 
funded companies ever end up making much money for their investors. And private 
sector investment is focused on a few very specific markets - those that promise the most 
rapid growth and the possibility for cash-out. And let’s not forget the spectacular herd 
mentality that can sometime seize the investment community: remember the Dot.com 
bubble and the Telecoms bubble? Corporate R&D spending has a similar mixed record: 
companies often fail to recognize the emergence of a disruptive technology and spend 
billions squeezing incremental performance improvement from the existing technology 
they use. 

Technology commercialization is HARD. It is also CRITICAL to the growth and 
economic competitiveness of the United States. For those of us out here in the trenches, 
the ATP is a vital source of support. ATP is unique in that it specifically focuses on 
helping bridge the chasm from the lab to the marketplace. Unlike the much larger SBIR 
programs that are run in many agencies, ATP provides stable and market-oriented 
support for small companies as they cross the chasm. Unlike the private sector, ATP 
invests in new technologies and new companies at a stage when the venture community 
would still turn up their nose. And let’s not forget that venture capital is concentrated in 
only a handful of major metropolitan centers in the US. 

Perhaps more importantly, the ATP is a beacon for scientists and would-be entrepreneurs 
that directs their attention to the value of technology commercialization. Whether or not 
an applicant company succeeds in winning a coveted ATP grant, the application and 
review process provides insightful and trenchant feedback for a company’s 
commercialization plans at a critical early stage in the life of a new company. 

As a nation we can choose to confront the forces of globalization through productivity- 
enhancing innovation and entrepreneurship or compete on the basis of low wages and 
lowered environmental and health standards. ATP is a small but valuable tool that plays 
to the best strengths of the US economy. Let’s not lose it. 



Dr. Peter Fiske 

Co-founder - RAPT Industries, Inc. 
Livermore, CA and Freeport, PA 
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UNITED STATES ADVANCED CERAMICS ASSOCIATION 

April 27, 2005 

The Honorable Senator Paul Sarbanes 
United States Senate 
Washington, DC 20510 

Dear Senator Sarbanes, 

As the Budget Committee moves to Conference on H. Con. Res, 95, the members of the United States 
Advanced Ceramics Association (USACA) request the Senate Conferees to incorporate the 
-amendmcntjntroduced^LSg Dator Levin (amendment 23 S> for the A dvanced Teclinology Program 
(ATP) of the National Institute of Standards and Technology (NIST) in its entirety into the Budget 
Resolution. The amwidment called for a funding level of $142.3 million- 

The Committee is to be commended for the wise investment in the Advanced Technology Program 
last year. ATP helps create newjobs via funding of high-risk, high payoff projects from all 
technology areas. ATP creates a bridge betN^'cen small, medium and large sized companies, research 
labs and the market place. To date, ATP has provided funding to participating organizations located 
in 44 states and the District of Columbia in advanced materials, biotechnology, electronics, energy, 
environmental and hydrogen technologies, imaging, nanotechnology, optics, photonics, and 
semiconductor technologies. Federal dollars are leveraged with private sector funds to support 
research and development of cutting-edge technologies with commercial potential and societal 
benefits. 

The members of USACA consider advanced ceramics technologies, one of the areas funded through 
ATP, as integral to key US defense and energy systems. Its membership is comprised of corporate 
irtterests from the manufacturing sector and ranges from the largest U.S. industrial companies to 
smaller corporations dedicated solely to the manufacture of advanced ceramics products. The 
members of USACA believe that the NIST ATP is a unique and successful federal program driving 
American business and technology growth and should be fbnded, 

On behalf of the members of the United States Advanced Ceramics Association, thank you for your 
consideration of diis request. 


Sincerely, 



Jeff Serfass 

Executive Director 

US Advanced Ceramics Association 


cc: Senator Carl Levin 


www.altarum.org 
Office of the President 


A L. "T A R. LJ 


May 26, 2005 


The Honorable Carl Levin 
Ranking Member 

Senate Committee on Armed Services 
SR228 Russell Senate office Building 
Washington, DC 20510 

Dear Senator Levin; 

I am writing to express my strongest possible support for the continuation of the ATP program 
which I understand is now faced with a threat to its funding. 

As a former Vice President of Research at General Motors, and the current CEO of the nonprofit 
Allarum Institute, I can speak with autliority on (he critical role programs like ATP play in 
moving promising technologies off “the bench” and into the marketplace where they can make a 
valuable and lasting contribution to our nation's competitiveness and the quality of life of our 
citizens. 

Some of the most promising technologies often languish for lack of the bridge funding needed to 
help them cross this divide from demonstration to market. I have seen the value of the ATP 
program in providing such critical bridge assistance and I strongly encourage you and your 
Senate colleagues to do all that you can to restore funding to this vital program. 

Thank you for your leadership on this matter and do no hesitate to contact me should you think 
there is anything else I can do to assist you in your efforts. 


Sincerely, 



Kenneth R. Baker 
President and CEO 


3520 Green Court, Suite 300. Ann Arbor, Ml 48105-1579 • P.O. Box 134(X)1, Ann Arbor, Ml 48113-4001 • (734)302-5602 • fax (734} 302-4996 
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3980 Ranchero Drive 'Ann Arbor, Ml 48108 


May 25, 2005 
Dear Senator Levin, 

During the 90s, I served as Chairman of the Auto Body Consortium headquartered in 
Michigan. We submitted a proposal and won an NIST ATP competition to reduce 
manufacturing variation in the manufacturing of auto bodies. The project was called the 
2 Millimeter Program. 

The results of this University/Industry/Government collaboration were remarkable. We 
significantly improved quality while lowering cost and shortening the time required to 
bring new models to market. Water leaks, rattles, wind noise and many other customer 
annoying problems were eliminated. 

A NIST GCR 03-856-1 report entitled "CLOSING THE COMPETITIVE GAP: A 
Retrospective Analysis of the ATP 2mm Project, details the economic impact of this 
project. To Summarize, this $5 million investment by the government resulted in a 
growth in GDP of $600 million and the full-time equivalent Jobs is almost 10,000. 

The bottom line is the NIST ATP is the only government program designed specifically 
to facilitate such University/Industry/Govemment collaboration to increase global 
competitiveness of America’s industry. We proved through teaming of America's 
Universities, Industry and Government we can capitalize on the $Biilions we are 
spending on University Research by suppliers rapidly innovating products to infuse into 
America's major corporations to thwart foreign competition. 

Who benefits from this type of collaboration ? First customers benefit. Recently I 
purchased a Cadillac STS. This Michigan built vehicle ranks very high in the JD Powers 
quality surveys. I have been a supplier to Toyota in Japan since 1971 and can tell you 
this vehicle is as good if not better than any Toyota built today. 

Second, you might ask GM CEO Rick Waggoner or Gary Cowger Group VP GM Global 
Manufacturing what contribution the NIST ATP 2 Millimeter Program had on the quality 
of GM Cars and Trucks. They are both very knowledgeable of the project. 

Third, suppliers benefited from the enhancements in technology brought about from the 
research funded by the NIST ATP funding. Fourth, Universities benefit from seeing 
their research results actually being implemented and benefiting society. The 
educational benefits to the students were also significant. Many found good jobs 
working for the companies that got to know them during the project. 
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Who received the $5 million fundlna 7 In the case of the Auto Body Consortium 2 
Millimeter Project ALL of the funding went to the Universities to fund research, industry 
provided engineers, equipment and facilities. Industry received NO NIST ATP 
FUNDING!! 

What could we do next if NIST ATP funding was available ! The Auto Body 
Consortium 2 Millimeter Project changed the way auto bodies are manufactured in 
America and today our quality is competitive. We are now discussing with the domestic 
auto industry a similar collaboration for changing the way Engines, Transmission, and 
Chassis subsystems are manufactured (As example; one Detroit auto maker spends 
$1 .2 Billion annually on transmission warranty). Industry recognizes the success of the 
previous NIST ATP projects. Our Universities are also excited about another successful 
project. We are ready to proceed; however, we need the NIST ATP. 

I don't know how other states are using NIST ATP to enhance global competitiveness of 
their industries; however, in Michigan we have seen tremendous success with NIST 
ATP. I would welcome the opportunity to meet with any members of congress who are 
interested in learning of my first hand experience with the NIST ATP. 



Coherix, Inc, 
dwightc@coherix.com 
734 922 4061 
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T/J 

Technologies inc. 


3850 Research Park Drive, Suite A 
P.O. 80x2150 

Arbor, Mi 481 06 

734-213-1637/ FAX: 734-213-3758 


Senator Carl Levin 
269 Russell Office Building 
United States Senate 
Washington, DC 

20510-2203 


29 May 05 


Dear Senator Levin- 

We at TJ Technologies recently became aware that usefulness of the Department of 
Commerce National Institute of Standards and Testing Advanced Technology Program 
(NIST ATP) is again being questioned. As a small business that is now significantly 
contributing to this country’s war on terror, country’s space exploration program, and to 
the global automotive industry because of technologies we developed and demonstrated 
under our two ATP contracts, we at T/J Technologies fully understand and appreciate the 
contributions of the ATP to U.S. small technology businesses. 

NIST awarded TJ two high risk, early stage materials technology development and 
demonstration contracts. One contract was for the development and demonstration of 
high performance, affordable materials for advanced lithium-ion batteries, the other for 
the development and demonstration of advanced, high performance materials for direct 
methanol fuel cells. Upon successful completion of both contracts, we were awarded 
advanced stored energy research and development contracts from the Department of 
Defense, NASA, and global automakers. Because of our business success, we were 
recently named one of Michigan’s “50 Companies To Watch”. 

Without these programs, TJ Technologies would not be a leader in the development of 
advanced lithium-ion batteries and JP-8 powered PEM fuel cells for ground vehicle, 
space vehicle, air vehicle and air launched weapon applications. 

I certainly hope that the NIST Advanced Technology program will be allowed to 
continue to select and nurture technologies that other government agencies and the 
investment community deem as too high risk. We are proof that this program works. 

Sincerely, 


James Chew 
Chief Strategy Officer 
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Office of the President 


May 27, 20D5 

Tt» Honorable Senator Carl Levin 
269 RUSSELL SENATE OFFICE BUILDING 
WASHINGTON DC 20510 


Dear Senator Levin, 

As President of the world's leading nanotechnology company, I'nn writing about a 
vary Important program that Is currently at risk of being under-funded; the NIST 
Advanced Technology Program (ATP). 

I've never been a big supporter of government spending on R&D funding — for any 
industry, 1 subscribe to the philosophy Uiat private industry's role is to bring about 
Innovation based on market drivers. While some mistakenly characterize the NIST- 
ATP as corporate welfare. I'll attest to the fact that the NIST-ATP fulfills a vital role in 
bringing the promise of nanotechnology to the American people. 

Zyvex's NIST-ATP involves a partnership between the University of Texas at Dallas, 
the University of Virginia, Rensselaer' Polytechnic Institute, and Honeywell, Inc. This 
prog ram is a prime example of how a small, Innovative nanotechnology company, 
partnering with key universities and businesses, revolutionize the manufacturing 
industry by developing and commerciaflzlng miccoassembly and nanotechnology. 

And, Zyvex is a real-world example of -a-small business that is leveraging this 
program to commercialize nanotechnology — today. We are creating new markets 
and law jobs. 

These nanomanufaeturing technologies wi|l not only allow the United States to regain 
the lead in this crucial global industry, they will also substantially stimulate our 
economy by enabling the U.S, to manufacture goods and services at a fraction of 
the|r current cost, I am enclosing some materials that describe the Impact and 
importance of the NIST-ATP to our nation, specifically in regards to the acceleration 
of nanotechnology. 

It's no surprise that America leads the world In technological innovation, Much of our 
leadarship position and the jobs generated for Americans can be directly attributable 
to elected officials such as yourself, and American programs like NIST, In return, 
NIS” fulfills a vital role In bringing the promise of nanotechnology to the American 
people. 


1321 North Plano Road Richardson. Texas 75081 
tel: 972 235 7881 fax: 972 235 7882 
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As anyone mho knoms me will attest. I'm known for profitably growing companies, 
not wasting money. NIST is our business partner, not simply an organization that 
gives us money. We jointly share the cost and responsibility of bringing this new 
technology to the marketplace. 

There is no doubt that the NIST-ATP bridges the funding gap in products and 
technologies that have public and private benefits with a five-to-ten year time to 
market. It's the ATP's cost-share structure that also serves as a model framework 
where government, universities, and industry can develop advanced technologies to 
meat our nation's challenges. 


Without the ATP, nanotechnology products that can provide new defense capabilities, 
energy independence, job stimulation, and health benefits will share an uncertain 
future. Some of these products are currently five-to-ten years away from 
commercialization, Do we want to concede these technologies, and their benefits, to 
countries like Taiwan, lapan, and China — countries known for their abundance of 
cheap, educated labor and patience In investment horizons? 

As you know, nanotechnology is a long-term solution for ensuring the United States' 
position as a leader: in the war on terrorism; solving pressing medical problems 
targeted to particular ailments; reaping the benefits of our research into the human 
gencme project; and re-establishing the United States as a leader In 
manufacturing— creating thousands of new jobs and increasing the prosperity of the 
American people. 

As I stated In my recent congressional testimony to the U.S. House of 
Representatives' Science Committee, I've grown increasingly wary as I travel ail over 
the world and see how aggressive countries such as China, Taiwan, Japan, and the 
European Community are funding initiatives very similar to NIST. I ask myself what 
kind of economic opportunities our children will have if the United States loses its 
industrial competitiveness to other countries if we decrease the NIST-ATP's budget. 

Many people will argue that with the War, these cuts are necessary. I ask how we 
can continue to fight a war on terrorism without developing the critical technology 
that is needed in the next decade, We're not only at war with terrorism, we are in 
the midst of a significant worldwide battle for technical prowess to sustain and 
Incrtiase our technological leadership In the world-the greatest economic battle of our 
lifeti me. 

Anything but increasing NIST-ATP's funding Is surrendering our economic prosperity 
and giving up on our promise to our children — a promise for a higher quality of life. 
Youf continued support and leadership of the NIST-ATP will ensure our future 
technological leadership position. 

Thank you in advance for your assistance in this critical endeavor. 



Thonas A, Cellucci, Ph,D., MBA 
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May 26, 2005 


The Honorable Carl Levin 

459 Russell Senate Office Building 

Washington, D.C. 20510 

Dear Senator Levin: 

1 am writing to provide the University of Michigan’s strongest endorsement of the National Institute of 
Standards and Technolog\''s (NIST) Advanced Technology Program or ATP. The U-M has been a 
research partner to companies participating in the ATP since NIST began funding these projects in 1 990. 
In fact, the U-M was a key research partner in an early, preeminently successful, ATP project, the Auto 
Body Consortium. 

The goal of the Auto Body Consortium project was to determine ways to minimize the variation in the 
manufacturing assembly process of U.S. automobiles. At the lime of the project award, Toyota’s auto 
body variations following final assembly were superior to .American-made vehicles (less than or equal to 

2 mm). The Auto Body Consortium, with General Motors and Chrysler in the lead, and the U-M and 
other automotive suppliers as partners, was able to develop processes and tools that achieved auto body 
assembly tolerances that matched or exceeded those of Toyota. U-M faculty and students were critical in 
this development. 

The Auto Body Consoriiuin is just one example of the power of the NIST ATP in bringing diverse 
companies and research organizations together. The Auto Body Consortium would never have been 
formed; original equipment manufacturers (OEMs), their suppliers, and academia would never have 
joined forces it not for the NIST ATP. In essence, the NIST ATP is a unique government-industry 
partnership that assists companies in accelemting the development of high-risk enabling technologies that 
can lead to new products or more competitive processes. The U-M has partnered with numerous 
companies (Michigan companies and otherwise) on over fifteen ATP projects since the program’s 
inception. 

'I'he NIST Advance Technology Program has been, and continues to be, one of the more effective federal 
programs that combines U.S. university research expertise with the needs and expertise of U.S. industry. 
The results of its projects bear directly on U.S. competitiveness. We at the University of Michigan 
strongly endorse the continued support of the NIST Advanced Technology Program. 



F'FU/jcr 
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May 2, 2005 


The Hon. Frank Wolf 
Chairman 

Subcommittee on Science, State, Justice, Commerce and 
Related Agencies 

House Committee on Appropriations 
H - 309 
The Capitol 

Washington, DC 20515-6017 
Dear Chairman Wolf; 

The undersigned companies, associations, universities and colleges and professional societies write 
to you on behalf of more than one million scientists and engineers, and 90 percent of America's 
industrial capacity. We urge Congress to increase investment in the National Institute of Standards 
and Technology (NIST) — which is vital to our industrial innovation, global competitiveness, and 
national security — by at least 7 percent overall from its FY 2005 level of funding, i.e. from $695.3 
million to $744 million. 

Under the Administration’s FY 2006 request, overall NIST funding has been slashed by 23.5%, or 
$163.4 million to only $532 million. While not a large agency, ongoing damage to NIST must be seen 
as part of a larger pattern of erosion of U.S. scientific talent and capability. 

It is vitally important that we understand the causal link between federal investment in our innovation 
infrastructure, and the ensuing benefits which result from this investment. In particular, we ask your 
support for the following NIST Programs; 

1 . NIST Laboratories 

The world-leading standards and measurement work carried on by NIST for a century underlies 
every test or experiment carried out in industry and higher education and provides the foundation for 
U.S. quality control, innovation and competitiveness. Any list of specific applications is lengthy and 
impressive. A cursory glance of essential programs would include: building and fire codes {including 
smoke detector sensitivity standards which have prevented many fire-related deaths every year); 
dealing with the terrorist threat; bullet-proof body armor; precision machining and semiconductor 
manufacturing; nanotechnology; cyber security; health care quality; voting technology; new fuel 
composition technologies; and the energy efficiency of appliances. 

The NIST Labs appropriation from Congress provides a foundation for NIST laboratories to conduct 
critical, and compensated, work on behalf of numerous other Executive Branch agencies like the 
Department of Homeland Security, the U.S. Department of Energy, the Department of Defense, EPA, 
etc. 


Coalition for NIST Funding c/o ASTRA, The Alliance for Science S Technology Research in America 
1550 16th Street, N.W., Washington, D.C. 20036 ♦ 202/872-6160 • www.aboutastra.org 
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Many independent studies show that every dollar invested in NIST measurement and standards 
nrnarams returns at least three dollars in national economic benefits . In the last few years, NIST 
scientists have garnered two Nobel prizes in physics, yet the cuts in the FY '06 budget guarantee risk 
a significant reduction in force because the President’s budget proposal does not include sufficient 
funds for other NIST priority programs. 

We support the Administration’s request to provide $420.6 million for NIST’s laboratory programs. 
Unfortunately, as recent Congressional hearings have demonstrated, it is unclear how much of this 
amount will actually go toward NIST Labs programs and how much will be needed to shut down the 
Advanced Technology Program (ATP) which is scheduled for elimination. Finally, a 12.7 % increase 
in NIST Labs' budget will only partly compensate for damaging cuts which occurred two years ago. 

2. Manufacturing Extension Partnership (MEP): 

We oppose slashing the MEP Program, which wouid be cut 56.5% from $107.5 million to $46.8 
million. Instead, we request Congressional support for MEP of at least $115 million. This would 
enable MEP to conduct activities at last year’s level, plus an additional 7 percent increase of $ 8 
million to cope with inflationary increases and enable the same level of effort from FY ’05. 

The MEP is a nationwide network of centers that supports centers that provide hands-on technical 
and business assistance to smaller manufacturers. Working through not-for-profit managed centers, 
the Centers are funded by federal, state, local and private resources to serve manufacturers. That 
makes it possible for even the smallest firms to tap info the expertise of knowledgeable manufacturing 
and business specialists all over the U.S. 

Centers often help small firms overcome barriers in locating and obtaining private-sector resources. 
MEP has assisted over 149,000 firms to date. In a survey of NIST MEP clients served from October 
2002 through September 2003, 4,865 companies around the country reported that as a result of NIST 
MEP services, they: created or retained 50,000 jobs; increased sales by $1.5 billion; retained 
another $2.6 billion in sales; and invested $912 million in modernization. 

As American manufacturing stagnates and U.S. manufacturing jobs continue to flow overseas (more 
than 2.3 million in the past three years alone). Congress should fund MEP at a minimal level to help 
our manufacturing sector remain competitive. 

3. Advanced Technology Program (ATP) 

NIST’s Advanced Technology Program (ATP) has been one of the most successful of all federal 
R&D programs. ATP bridges the gap between the lone researcher with a break-through idea, the 
entrepreneur, the research lab and the market place. 

ATP creates new jobs and helps struggling small companies survive their perilous journey through 
the “valley of death," i.e, the period between invention and proof of concept of a technology, and 
the actual financing, development and commercialization of the technology. ATP has awarded 709 
project grants from a universe of more than 5,200 deserving applications over the past decade. 

We can only conjecture what potential inventions and technologies were passed over by ATP’s 
dedicated staff due to budget restraints. We will never know for sure what patents were lost and 
what industries of the 21st Century could have enjoyed a U.S. base of operations but for “budgetary 
savings” that short-changed ATP, our economy and our workforce during the last Recession, 
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Out of 709 projects selected by the ATP since its inception, well over half of the projects included one 
or more universities as subcontractors or Joint-venture members. Seventy-nine percent of all single- 
company awards are won by small firms, and half of all joint ventures are led by small or medium- 
sized companies. The ATP is the most thoroughly reviewed federal R&D program - and it has held up 
to the scrutiny. A National Academies of Science panel headed by Intel co-founder Gordon Moore (of 
“Moore’s Law" renown) found as follows: “The ATP is an effective federal partnership program ... (I]t 
appears to have been successful in achieving its core objective, that is, enabling or facilitating private- 
sector R&D projects ... where social returns are likely to exceed private returns to private investors.” 

We request that ATP be funded at the level recommended in the Senate Budget Resolution 
adopted in March 23 of this year: $142.3 million. 

4. Baldrige Quality Award 

Also not to be overlooked are the Baldrige Quality Award - we support the Administration request to 
increase its funding by 4.9% to $5.7 million from $5.4 million. This small sum is matched by about 20 
times that effort in industry — and each year thousands of organizations use the Baldrige criteria to 
improve their own performance standards. A hypothetical portfolio of the stocks of Baldrige award- 
winners has outperformed the S&P 500 Index in 9 years out of 10, and by margins of up to 6:1. How 
many federal programs far surpass original expectations? 

Conclusion 

NIST is a vital agency whose work to make American industry the most efficient and productive in the 
world should be promoted, not cut back. 

Deep cuts in NIST's budget are totally inappropriate at a time when America's foreign competitors are 
closing in on us with a wide array of technologies and strategies . With our innovation “ecosystems" 
being challenged worldwide on virtually all fronts, America cannot afford to short-change NIST and 
our nation's innovation future. 

Sincerely, 


The Undersigned 

(Please see attached listing current as of May 2, 2005) 


limonation Is America’s Economic Hcartneat. 

Don’t flat Line our futurel 


^ Coalition for NIST Funding do ASTRA, The Alliance for Science & Technology Research in America 
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Why increase NIST Funding, and Why Now? 

The National Institute of Standards and Technology (NIST) is a crown jewel of U.S. scientific achievement 
and publicly-funded science. Founded in 1901 as the National Bureau of Standards, NIST is administered as a 
part of the U.S. Department of Commerce’s Technology Administration. NIST is an essential part of a now-de- 
teriorating federal scientific infrastructure. 

A decade-long failure to adequately fund basic scientific research for the physical sciences and engineering 
has already had dire consequences for U.S. job creation, competitiveness, and our national security. A recent 
Benchmarking Study by the Task Force on the Future of American Innovation (see www.futureofinnovation. 
org) details the effects of long neglect of America’s basic research infrastructure, of which NIST is a key 
component. 

NIST programs play a critical, if unappreciated, role In the health of the underlying basic scientific research 
necessary to remain competitive in the robust and globally competitive 21st Century Economy. 

U.S. Industry & Science Need a Healthy National institute of Standards and Technology 

Massive cuts in the NIST Budget In FY '06 have been proposed to help balance the federal budget. Specifi- 
cally, the Administration’s FY ‘06 Budget for NIST calls for cutting $163.4 million from the agency — a 23.5% 
decrease overall. 

Four critical NIST programs have been allowed to languish over the past decade, each of which has tremen- 
dous impact on U.S. job creation, innovation, and scientific progress, as detailed below. 

NIST Laboratories — From Nobel Laureates to Layoffs? 

The NIST laboratories play an Important, niche-role in today’s complex technology-driven economy. Industry 
relies on the NIST labs for measurements and standards that no one else can provide. We need NIST's 
measurements and standards capacity so that we can make and improve products and services. For 
example: measuring and manufacturing nano-sized scale materials and devices: developing new and secure 
information and communications technologies that work together easily; improving the efficiency and quality of 
U.S. manufacturing: and enhancing homeland security. 

The labs cover practically every area of science and technology. Their work is carried out by a relatively small 
but very talented team of researchers - who have garnered two Nobel Prizes In Physics and a MacArthur 
“Genius Award” in just the past eight years. The impact of the NIST labs’ work is documented in dozens 
of economic studies showing an enormous return on investment: every dollar invested in NIST labs returns 
at least three dollars In economic benefits to the nation. Too often, because of their relatively small size, their 
location In the Commerce Department, and the "nuts and bolts” infrastructural role that the labs play, they are 
overlooked when R&D budgets are set. 

While NIST Labs would ostensibly receive an increase in their FY ‘06 funding under the President’s proposal, 
the increase is illusory: most of these monies will be devoted to catching up with past shortfalls within the Labs 
budgets or accounting for NIST Program terminations or reductions, like the ATP and MEP Programs. 

NIST’s Manufacturing Extension Partnership (MEP) Program 

The MEP is a nationwide network of centers that supports centers that provide hands-on technical and 
business assistance to smaller manufacturers. Working through not-for-profit managed centers, the Centers 
© 2005 ASTRA, The Alliance for Science & Technology Research in America — www.aboutastra.org 
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are fur^ded by federal, state, local and private resources to serve manufacturers. That makes it possible for 
even the smallest firms to tap into the expertise of knowledgeable manufacturing and business specialists all 
over the U.S. 

These specialists are people who have had experience on manufacturing floors and in plant operations. Each 
center works directly with area manufacturers to provide expertise and services tailored to their most critical 
needs, which range from process improvements and worker training to business practices and applications of 
information technology. Solutions are offered through a combination of direct assistance from center staff and 
outside consultants. 

Centers often help small firms overcome barriers in locating and obtaining private-sector resources. MEP 
has assisted over 149,000 firms to date. In a survey of NIST MEP clients served from October 2002 through 
September 2003, 4,865 companies around the country reported that as a result of NIST MEP services, they: 
created or retained 50,000 Jobs; increased sales by $1.5 billion; retained another $2.6 bliiion In sales; 
and invested $912 million in modernization. 

In 2003, the MEP was sliced by two-thirds despite support by more than 300 Members of Congress who spoke 
up too late. In 2004, it was saved at the last minute and received about $108 million. Now. the Administration 
proposes slashing it to about $45 million per year. 

Creating New Jobs & Industries: The Advanced Technology Program (ATP): 

A World-Emulated Program Bridging the Gap Between Invention and Innovation 

NIST's Advanced Technology Program (ATP) has been one of the most successful of all federal R&D 
programs. ATP bridges the gap between the lone researcher with a break-through idea, the entrepreneur, the 
research lab and the market place. ATP creates new jobs and helps struggling small companies survive their 
perilous journey through the so-called “valley of death,” i.e. the period between invention and proof of concept 
of a technology, and the actual financing, development and commercialization of the technology. ATP has 
awarded 709 project grants from a universe of more than 5,200 deserving applications over the past decade. 

Out of 709 projects selected by the ATP since its inception, well over half of the projects included one or more 
universities as subcontractors or joint-venture members. Seventy-nine percent of all single-company awards 
are won by small firms, and half of all joint ventures are led by small or medium-sized companies. The ATP is 
the most thoroughly reviewed federal R&D program — and it has held up to the scrutiny. A National Academies 
of Science panel headed by Intel co-founder Gordon Moore (of “Moore’s Law” renown) found as follows: “The 
ATP is an effective federal partnership program ... [IJt appears to have been successful in achieving its 
core objective, that is, enabling or facilitating private-sector R&D projects ... where social returns are 
likely to exceed private returns to private investors. ” 

NIST’s Malcolm Baldrige National Quality Award Program is a Huge Success 
... that costs almost nothing — a mere $5 million or so, matched by 20 times that effort in it 
year thousands of companies use the Baldrige criteria to improve their performance. A 
hypothetical portfolio of the stocks of award-winners has outperformed the S&P 500 Index 
in 9 years out of 10, and by margins of up to 6:1. How many federal programs far surpass 
original expectations? 

Q; What Can Congress do to Help Restore Discovery, Job Creation & 

Competitiveness Through NIST? 

A: INCREASE NIST FUNDING! 
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Core Findings and Recommendations 

The National Academies Committee on Government-Industry Partnerships 
Review of ATP * 

1. The Committee finds that the Advanced Technology Ptogram is an effective federal 
partnership program. The selection criteria applied by the program enable it to meet 
broad national needs and help ensure that the benefits of successful awards extend 
across firms and industries. Its cost-shared, industry-driven approach to funding 
promising new technological opportunities has shown considerable success in advancing 
technologies that can contribute to important societal goals such as improved health 
diagnostics (e.g., breast cancer detection), developing tools to exploit the human genome 
(e.g., colon cancer protection), and improving the efficiency and competitiveness of U.S. 
manufacturing. 

2. The program’s peer review of applicants for both technical feasibility and commercial 
potential supports its goal of helping advance promising new technologies that are 
unlikely to be funded through the normal operation of the capital markets.^ 

3. The program has set a high standard for assessment involving both internal and 
independent external review. The quality of this assessment effort lends credence to the 
program's evaluation of its accomplishments.'^ 

4. The extensive assessments of the program show that it appears to have been successful 
in achieving its core objective, that is, enabling or facilitating private sector R&D 


* Text is excerpted from National Research Council, The Advanced Technolo^ Program: Assessing OutcomeSy Charles 
W. Wessner, ed., Washington, D.C.: National Academy Press, 2001. These summary findings and 
recommendations are elaborated and documented below. In addition to the papers and proceedings in this 
volume, the Committee issued National Research Council, The Advanced Technoto^ Pro^am: Challenges and 
Opportunities y Washington, D.C.: National Academy Press, 1999. The ATP assessment program also provides 
extensive documentation regarding the contributions of the program. See Annex D in this volume. See also 
William F. Long, Advanced Technoiogs Program: Performance of Completed Projects: Status p£port Number f, NIST 
Special Publication 950-1, March 1999. 

2 See Section I in this chapter. For a summary of the differentiating characteristics of the ATP, see Maryann 
Feldman's analysis in Section C of the Introduction and the study by Feldman and Kelley, "Leveraging 
Research and Development The Impact of the iVdvanced Technology Program," both in this volume. 

^ With regard to the ATP selection process see the presentation by former ATP Director, Lura Powell, in the 
first volume of this study, National Research Council, The Advanced Techno/og/ Program: Challenges and 
Opportunities, op. cit., pp. 53-56; with regard to the role of venture capital finance and the need for a bridging 
mechanism, see the statement by Todd Spener of Chatter Financial in the same volume, pp. 90-91, as well as 
the presentation by Joshua Lemer of the Harvard Business School, pp. 88-90. See also the presentation by 
venture capitalist Datid Morgenthaler in Panel I of the Proceedings of this volume and the summary of his 
statement in Section C of the Introduction to this volume. See also Lewis M. Btanscomb and Philip E. 
Auerswald, Taking Technical Pdsks: Hotv Innovators, Manaus and Investors Manage Risk in High-Tech Innovation. 
Cambridge: MIT Press, 2001, Chapter 5 and passim. 

^ See Section I in this chapter and the description of the program, its current results, and the ATP assessment 
effort by Rosalie Ruegg and the positive review of the assessment program by Irwin Feller of Pennsylvania 
State University in Panel II in this volume. See also the panel discussion led by Richard Nelson of Columbia 
University, including the description of the ATP assessment, its early beginnings, and its focus on tools for 
assessing technology spillovers in National Research Council, The Advanced Technology Program: Challenges and 
Opportunities, op. cit, pp. 71-80. 
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projects of a type, or in an area, where social returns are likely to exceed private returns 
to private investors.^’ 

5. The Committee does recommend a series of operational improvements designed to 
make this program more effective and suggests several measures designed to bring the 
benefits of the AlP to other national initiatives and to state technology programs 
through enhanced cooperation/ 

Accomplishments of the Advanced Technology Program 
A. Meeting Legislative Goals: 

The Advanced Technology Program is achieving the goals ascribed to the 
program in the Omnibus Trade and Competitiveness Act of 1988, As initially stated, 
its goals were "to assist U.S. business in creating and applying the generic technology 
and research results to (1) commercialize significant new scientific discoveries and 
technologies rapidly and (2) refine manufacturing technologies." (P.L. 100-418). The 
AIT emphasizes economic growth and advances the competitiveness of U.S. firms 


5 See, for example, the paper by Maryann Feldman and Maryellen Kelley, "Leveraging Research and 
Development: The Impact of the Advanced Technology Program," in this volume. The study by Albert N. 
Link, "Enhanced R&D Efficiency in an ATP-funded Joint Venture," documents the impact of an ATP joint 
venture designed to reduce the costs and timing requited to develop a suite of new technologies for the U.S. 
printed wiring board industry. The study finds a dramatic effect on R&D efficiency, resulting in cost savings 
on the order of $35 million wliile reducing cycle times for new product and process development. The project 
resulted in productivity improvements for member companies, diffusion of new technology to other producers, 
and improved competitive positions for and retained employment at participating companies. The study by 
David Austin and Molly Macauley, "Estimating Future Benefits from ATP Funding of Digital Data Storage," 
estimates substantial consumer welfare gains from ATP-funded innovations in digital data storage although the 
final impact is dependent on the adoption of tlic technologies. Similarly, tlie paper by Tajder H. Bingham, 
"Estimating Economic Benefits from ATP Funding of New Medical Technologies," projects substantial social 
returns, much larger than the projects' private returns, primarily due to the projected positive spillovers to 
patients treated with new technologies. 'Ihese technologies focus on the diagnosis and treatment of cancer; the 
treatment of diabetes, damaged ligaments and tendons; and the transplanting of xenogeneic organs. The 
overview of the progress of ATP awards by Rosalie Ruegg, "Taking a Step Back: An Early Results Overview of 
Fifty ATP Awards," documents both commerciali 2 ation progress and knowledge creation and dissemination. 
The latter is documented through outside recognition of the project's technical accomplishments, patents filed 
and granted, patent-tree citations, collaborative relationships, and knowledge disseminated through new 
products and processes. Ruegg records substantial evidence that benefits are extending well beyond tliose 
captured by award recipients. The papers cited above are included in this volume. 

^ For an excellent review of the factors affecting the generation and impact of social returns or spillovers, see 
Adam B. Jaffe, Economic Anafysis of Research Spillovers: Implications for the AdvancedTechnolog)! Program, NIST GCR 
97-708, December 1996. For aditionai ATP-supported research on social benefits, see Edwin Mansfield, 
Estimating S octal and Private Returns from Innovations Based on the Advanced "Xechnolo^ Program: Problems and 
Opportunities, NIST GCR 99-780, January 1996; William F. Long, Performance of Completed Projects, Status Report 
Number 1 , op. cit.; Wesley M, Cohen and John Walsh, Spillovers, Appropriability, and Re9°D intensity: A Survey- 
Based Approach, Gaitliersburg, MD; National Institute of Standards and Technology, Forthcoming; and Michael 
S. Fogarty, Amit K. Sinha, and Adam P>.]‘:siie,,ArP and the US Innovation System: A Methodology for Identifying 
Enabling R(&D Spillover Networks with Application to Microekctro-mechanical Systems (MEMS ) and Optical Recording, 
Gaithersburg, Jv'ID: National Institute of Standards and Technology, Forthcoming. 

See Sections II and III in this chapter. 
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by fostering technologies with potentially large net social value for the nation that 
might not otherwise emerge in time to maximize their competitive value.® 

B. Supporting Enabling Technologies: 

The ATP focuses its support on enabling technologies that face substantial 
technical barriers yet which also have the potential for broad-based economic 
benefits. Program goals and examples of technologies illustrating the ATP approach 
and meeting the program’s current operational objectives are: 

1 . Improved manufacmring efficiency and competitiveness. ATP 
contributions are illustrated by Extrude Hone’s contribution to 
manufacturing efficiency and the environment and by the successful U.S. 
Printed Wiring Board consortium.’ Other contributions include an "ion 
implantation" technology to reliably process larger, and hence more 
productive, 300mm wafers economically. The ATP helped fund the 
development of advance process control (APC) technology for 
semiconductor production, which increases process consistency and yield.’" 
Working with large and small companies, the program also helped develop a 
novel insulating material to improve performance of computer chips.” 
These innovations should help maintain the exceptionally high historical 
annual growth in productivity, on the order of 25-30 percent, which 
characterizes the semiconductor industry. 

2. More rapid commercialization of technologies with positive spillovers, 
such as the mammography diagnostic instrument recently brought to 
market.”^ Work is also under way to develop miniaturized DNA analyzers 
designed to increase the speed of research and medical testing for diseases 
such as HIV, strep infections, or cancer.” 


® The Introduction to this volume provides the policy context which led to the creation of the ATP and other 
cooperative programs and summarizes legislation designed to encourage cooperative technology programs, 

The legislation establishing the A'lP is reproduced in Annex A. 

^ For a discussion of the manufacturing and environmental efficiencies made possible by Extrude Hone's 
advanced manufacturing processes, see the presentation by Larry Rhoades in Panel III of this volume. For a 
summary of the accomplishments of the PWB consortium see the analysis by Albert Link, "Enhanced R&D 
Efficiency in an A'fP-funded Joint Venture" in this volume. 

The APC technology was developed in cooperation wth SEMATECH and leading U.S. firms, such as 
Hone)^ell, Inc., Advanced ivliero Devices, and IBM, among others. 

Developed by Texas Instruments and NanoPore, Inc., a small New Mexico-based company, the insulator is 
called Xerogel, which consists of a highly porous, glass material used as a low dielectric constant insulating layer 
in integrated circuits. The innovation has led to an estimated twenty patents and patent applications and 
represents a positive development for U.S. industry. 

Recently approved for climeal use by the Food and Drug Administration, the new system represents a 
significant technological advance in breast cancer detection. It uses a unique amorphous silicon detector that 
provides high quality imaging wliich can be digitally enhanced and rapidly verified. A 1995 ATP project 
awarded to General Electric and EG&G Reticon developed a new manufacturing process that significantly 
reduced the manufacturing cost of the amorphous-silicon panels used in the new detection system, making this 
superior detection system more affordable and available to a greater number of women. See 
http:/ /wwuAnist.gov/piiblic affairs/update/updQ0Q410.htm#Health See also footnote 40 in this chapter. 

See National Research Council, The Advanced Technology Prog'om: Challenges and Opportunities, op. cit., p. 55. 
Microtechnologies under development offer significant advances in the convenience and speed of DNA 
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3. Contributing to the development of technologies embodying recent 
scientific discoveries, such as the award to PPL Therapeutics to develop a 
way to produce valuable stem cells ftom adult human cells, possibly creating 
a non-controversial alternative to the use of embryonic stem cells. Stem cells 
hold the promise of fighting diseases ranging from heart failure to 
Parkinson’s. 

4. Catalyzing and supporting research parmerships between industry on the 
one hand and U.S. university researchers and federal laboratories, on the 
other. Through 2000, 176 universities have been involved in the program, 
participating in over half (56 percent) of the program's 522 projects, either as 
full participants or subcontractors. Some 50 projects have included federal 
laboratories. These parmerships help speed the transfer of publicly-funded 
basic research and expertise to industry.’* 

C. An Exceptional Assessment Effort: 

The AIT assessment program has produced one of the most rigorous and 
intensive efforts of any U.S. technology program. This program has two elements: 
an in-house effort based at NIST Headquarters and an external effort contracted 
with the independent National Bureau of Economic Research.'* The quality, 
quantity, and analytical range of these smdies are impressive. Over 58 case smdies 
and other assessments have been completed; substantial additional work is under 
way," With regard to this assessment program, several points emerge: 

1 . It is important to note that these smdies, by their very nature, do not 
endorse every aspect of the program. They do provide valuable insights into 
the operation and impact of the program. 

2. The broad scope of the studies offers insights into the operations of the 
U.S. innovation system, for example, with respect to early-stage finance of 


analysis. One such company, Affymetrix, has developed chip systems which can detect genedc variations 
related to HIV’, cancer, and drug metabolism. The company has also received a grant from the Human 
Genome Research Institute. 

See Erika Jonietz, “Sourcing Stem Cells: Could New Research End the Embrt'O Debate?” Technohp Remiiv, 
January/February 2001, p. 32. 

For an earlier discussion of this point, see the presentation in Panel 11 by Rosalie Ruegg, Director of the ATP 
Economic Assessment Office at the time of the conference. The universities most involved in A'lT projects 
include: Stanford University; the University of Michigan, Ann Arbor; the Massachusetts Institute of 
Technology; Cornell University; Johns Hopkins University; the University of Minnesota; Carnegie Mellon 
University; Pennsylvania State University; the University of California, Berkeley; and North Carolina State 
University. 

See the discussion of the ATP assessment program in Panel HI of National Research Council, TheAibanad 
Technohg Program: Challenges and Opportunities, op. at., pp. 70-82, especially p. 79. This section describes ATP's 
substantial involvement of outside experts, both in the selection process through peer review, and the valuable 
input provided ftom the outset of the program through consultations with leading economists from the 
National Bureau of Economic Research (NBER), which included important contributions by Professors Zvi 
Griliches and Edward Mansfield, This collaboration continues under the overall direction of NBER's Adam 
jaffe. 

' ^ See Annex D of this volume for a list of studies commissioned by the ATP Economic Assessment Office, 
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promising technologies and the impact of the intellectual and economic 
spillovers derived from the program.^* 

3. These studies are also makii^ a contribution to our understanding of the 
U.S. innovation system and to the development of methodologies to measure 
the impact of federal and state technology programs such as the ATP.^'”^ 

4. Few other federal technology programs have embraced this level and 
intensity of assessment and sought to apply its results as diligendy as the 


II. Recommendations to Improve the Program 

A. Extend the window for award applications, accelerate the decision- 
making process for awards, and extend substantially the period in which 
awards can be made. New, commerciaUy-relevant technologies are often time 
sensitive. Fixed periods for firms to apply to the program and long delays in 
notification of awards may reduce the attractiveness of the program, in particular to 
new, small firms. Faster decision-making also would enhance the value of the 
debriefing process for unsuccessful firms.^’ This revolving application process will 


National Research Council, The AdvancedTechnoio^^ Program: Challenges and Opportunities, op. cit., pp. 79-80. Sec 
also Adam Jaffe, "The Importance of 'Spillovers' in the Policy Mission of the Advanced Technology Program," 
Journal ofTechnologj! Transfer, 23(2);11-19, 1997; E. Mansfield, EstimatingSodal and Private Returns Jhm Innovations 
Based on the Advanced Technology Pro^am: Problems and Opportunities, op. cit.\ Wesley M. Cohen and John Walsh, 
ReFD Spillovers, Appropriability, and Rcd^D Intensity: A Survty-Based Approach, op. cit.\ and D. Mowery, J. E. Oxley, 
and B. S. Silverman, Knowledge Spillovers and R^D Joint Ventures, Gaithersburg, MD: National Institute of 
Standards and Technology, Forthcoming. 

As noted above, an excellent example is the recent work by L. M. Branscomb and P. E. Auerswald, Taking 
Technical Risks, op. cit. Initially sponsored by the ATP, this volume reviews some of the factors affecting early- 
stage financing and notes a serious gap between the creation of an idea and its reali 2 ation in a technology that 
meets market requirements for investors. With regard to interaction with state programs see Marsha R.B. 
Schachtel and Maryann P. Feldman, Reinforcing Interactions Between the Advanced Technology Program and State 
Technology Prog'ams, Volume I: A Guide to State Business Assistance Programs for New Technology Creation and 
Commercialii^tion, Washington, D.C.: U.S. Department of Commerce, April 2000. 

F'or example, the SBIR program, currently allocated over 51-2 biUion annually, is six times larger than the 
ATP, yet it has been subject to almost no systemic external assessment, apart from a series of GAO reports and 
the recently completed National Research Council study. The Small Business Innovation Research Program: An 
Assessment of the Department of Defense Fast Track Initiative, Washington, D.C.: National Academy of Press, 2000. 
Similarly, widely used cooperative research and development agreements (CRiVDAs) normally have limited 
assessment mechanisms. These limitations are described by D. Mowery in “Using Cooperative Research and 
Development Agreements as S&T Indicators: What do We Have and What Would We Like?," a presentation 
before the National Science Foundation conference. Workshop on Strategic Research Partnerships, 13 October 2000, 
pubEcation of proceedings pending. Some partnership programs have benefited from regular assessment such 
as the Program for Next Generation Vehicles and the Advanced Battery Consortium. See National Research 
Council, Review of the Research Program of the Partnership for a New Generation of Vehicles: Sixth Report, Wasliington, 
D.C.: National Academy Press, 2000, and National Research Council, Effectiveness of the United S tales Advanced 
Battery Consortium as a Government-Industry Partnership, Washington, D.C.: National Academy Press, 1 998. 

For a description of program modifications undertaken by the ATP management in the course of this review, 
see Alan P. Balutis and Barbara Lambis, "The ATP Competition Structure," in this volume. 
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provide greater opportunity for applicants. It will also give the ATP management 
earlier and more accurate information concerning the rate of awards than is available 
under an annual award process.^ 

B. Retain the debriefing process for unsuccessful applicants. Unsuccessful 
awardees find the debriefing process after an unsuccessful application to the ATP to 
be valuable even though more than thtee-fifths of the non-winners do not proceed 
with any aspect of the R&D project that they proposed to A'lT.^’ 

C. Concentrate a significant proportion of the awards in selected thematic 

areas. One of the key features of the ATP is its use of general competitions, which 
are open to proposals from all areas of technology. The goal of the program is to 
compensate for market imperfections that result in under-investment in certain types 
of technologies, a goal that distinguishes it from mission-oriented (and mission- 
constrained) R&D programs.^'’ These general competitions should be maintained. 

At the same time, they could be usefully supplemented by allocating a proportion of 
ATP funding in selected thematic areas where the current technological 
opportunities are particularly promising for broad economic or social benefits. 
Awards to thematic areas can also be a means of addressing elements of important 
national missions and of generating synergies between related projects, and among 
companies, laboratories, and universities in areas of current technological promise. 

In these cases, the program should attempt to reap the higher returns from realizing 
complementarities and synergies among projects and R&D-performing institutions.^* 

D. Enhance current efforts to integrate assessment results into the decision 
process. As noted, the quality of the ATP assessment effort is a major attribute of 
the program. The integration of the results of the assessments must remain a major 
goal of the program.^ The early release of outside assessments to the research 
community would facilitate the dissemination of the research results. 

E. Increase the Nation's Return on the Operation of the Program 

1. Maximizing Return: As noted above, the program is achieving its 
goals.^’ It has a deserved reputation as a program that is well-managed and 


^ Faster decision making has also been a concern for the SBIR program. The Department of Defense 
launched a successful initiative known as the Fast Track for firms able to demonstrate the ability to attract 
third-party finance. See National Research Council, The Small Business Imovation Research Pmgram: An Assessment 
of the Department of Defense Fast Track Initiative, op. dt., passim. 

See the paper by Maryann P. Feldman and Maryellen R. Kelley, "Leveraging Research and Development: The 
Impact of the Advanced Technology Program," in this volume. 

j. Lerner and C. Kegler, "Evaluating the Small Business Innovation Research Program: A Literature Review," 
in National Research Council, The Small Business Innovation Research Propram: An As.tessment of the Department of 
Defense Fast Track initiative, op. cit., pp. 309-314. For an informed discussion of U.S. technology policy see L. M. 
Branscomb and R. Florida, "Challenges to Technology^ Policy in a Changing World Economy," in Branscomb 
and Keller, Investing in Innovation, op. cit. 

te The generation of “social capital” made possible by these awards underscores the role of government finance 
for technological innovation. 

See Panel II, in this volume, where current efforts to integrate evaluation findings are described. 

This does not mean that all awards are crowned with success. As would be expected for a high-risk R&D 
program, a significant portion of the awards do not succeed. This experience strongly parallels the experience 


6 



207 


under which awards are fairly awarded.^ In our view, based on this review of 
the program, the ATP could use more funding effectively and efficiendy, 
consistent with the goals set for the program. A more predictable funding 
base would also ensure that the program continues to attract quality 
proposals, provide flexibility to address new opportunities and ensure the 
maximum return on existing investments. 

2. Stability for R&D Funding: In any case, every effort should be made 
to provide greater stability in the funding of the program. The current 
instability creates uncertainty for participants and potential applicants about 
the funding of multi-year program commitments and is particularly difficult 
for small firms 


Policy Context for Partnerships: 
Battles over the ATP Appropriation 



of venture-backed investment. For example, one study found that out of a sample of 794 venture capital 
investments made over three decades, only 22.5 percent ultimately succeeded in going public: see P.A. 
Gompers, "Optimal investment, monitoring, and the staging of venture capital," Journa/ of Finance 50(5):1461- 
1489. Concerning program evaluation, see the discussion m Panel II, especially the remarks by Irwin Feller of 
Pennsylvania State University, in this volume and Panel IV, especially the presentation on "Economic Returns 
to New Medical Technologies" by Taylor Bingham of the Research Triangle Institute, also in this volmne. 
Concerning program accomplishments (and failures), see the overview provided by Rosalie Ruegg, "Taking a 
Step Back: An Early Results Overview of Fifty ATP Awards," in this volume. 

28 Feldman and Kelley, “ITie Case for Government R&D Additionality " op. cit. The authors provide evidence 
that the investment community attaches value to the ATP awards through the highly selective and competitive 
nature of the award process. A significant percentage of even the non-winners in the selection process found 
the debriefing process to be helpful suggesting useful guidance for improving the firm's technical and/or 
business planning was made available. 

2^ Roger Noil and Linda Cohen emphasize the need to avoid large swings in annual funding for R&D 
programs. See The Technology Pork Barrel, Washington, D.C.: The Brookings Institution, 1991, p, vii. 
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F. Continue Focus on Small Business: A significant portion of the program 
funds (i.e., mote than 60 percent) are awarded to small business. This reflects small 
business's unique capabilities as a source of low-overhead innovation,” 
Notwithstanding this recognition of the innovative capabilities of small business, the 
diversity of the AIT awards, involving both large and small companies, is an 
important feature of the program, and should be retained (see G below). The 
substantial size of the ATP awards, their multi-year disbursement, and the 
opportunity to collaborate with other institutions (e.g. universities) and larger firms 
make ATP funding particularly attractive to small firms. The ATP can thus 
contribute to the development of new technologies that meet its criteria of broad 
social benefits and enhance returns on the U.S. investment in research. 

G. Retain Joint Ventures and Large Company Involvement: The participation 
of large companies is a unique and valuable characteristic of the ATP,^' Large 
companies bring unique resources and capabilities to the development of new 
technologies and can be valuable partners for technologically innovative companies 
new to the market.’^ The participation of larger companies can also ensure better 
access to downstream markets for the small firms with which they collaborate under 
this program.” Accordingly, awards to joint ventures involving large companies 


David B. Audretsch and Roy Thurik, Innovation, Industry, Evolution, and Employment, New York: Cambridge 
University Press, 1999. 

Dr. Mary L. Good describes the leverage offered by an ATP award to win internal support for a promising 
technology at Allied Signal. As Dr. Good describes it, the award fit the conditions associated with AIT (i.e., 
early technology development, an enabling technology, and collaborative work with universities resulting in the 
creation of a new material). She adds that the capabilities of a large company (i.e., expensive equipment and 
experienced technologists) were crucial to the success of the award. L. M. Branscomb et al,, Managn^ Technical 
Vdsk: Understanding Private Sector Decision Making on Early Stage, Technology-based Projects, NIST GCR 00787, 
prepared for the Advanced Technology Program, April 2000, p. 42 
For a further discussion of this point see C. Hill, "The Advanced Technology Program: Opportunities for 
Enhancement," in Branscomb and Keller, Investing in Innovation, op. cit., p, 159-160. Hill suggests that because 
R&D decisions are often decentralized, large firms may operate much like independent, small firms particularly 
for projects that have high ratios of social to private returns. 

” The development and marketing of the digitaUy-enhanced mammography diagnostic 
instrument (referred to in footnote 19) illustrates the synergy between large and small firms. 
The substantial marketing advantage of an established firm such as GE means the benefits 
of this new technology are rapidly and widely distributed. The laboratory manager 
responsible for developing the mammography diagnostic technology. Dr. Bruce Griffing, 
states that this promising technological development might well not have occurred in the 
absence of a government R&D award from the ATP. As noted above, this diagnostic 
system produces substantially fewer false positives. The lower false positive diagnoses 
reduce the need for expensive "workups" with the associated health care costs and personal 
trauma. Over time, the technology has the potential to virtually eliminate costs associated 
with film storage, retrieval, and transmission. The social benefits or spillovers appear 
substantial. 

The development of this technology also illustrates the impact federal R&D awards can have on 
decision making in large companies where multiple options, established hurdle rates, and technological and 
market uncertainties mitigate against even promising technologies. As Dr. Gtiffmg remarked in a recent 
seminar, "There is a valley of death for new technologies, even in the largest companies." Between Invention and 
Innovation: Mapping the Fundingjor Early Stage Technoh^s, Carnegie Conference Center, 25 January 2001, 
Washington, D.C. 
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should be retained. The current 60 percent funding requirement for large companies 
should also be retained; it should not, however, be significantly increased. 

H. Coordinate ATP with SBIR: The SBIR and the ATP programs are different in 
important ways. However, they can be understood as separate steps on a national 
innovation ladder. In cases where applicants to the ATT do not have sufficiently 
developed business plans, but do have sound technologies, they might well be 
remanded automatically to an appropriate SBIR program. To the extent their 
technology has met the requirements of the ATP, SBIR program managers could be 
assured of the potential of the proposed technolog}'.’^ 


III. New Initiatives for the Program 

A. Increased Collaboration on National Initiatives 

ATP’s collaboration with agencies responsible for national initiatives such as 
the Human Genome should be substantially increased. The Advanced Technolog)' 
Program has established a “core competency” in its ability to screen, select, monitor, 
and assess projects of technological and commercial promise. As such, the ATP 
would be a valuable partner to research agencies and SBIR programs by working 
with them to develop valuable enabling technologies based on their investments in 
health and other areas such as environmental remediation.^® 

The National Institutes of Health have shown unparalleled capability in tlie 
funding of basic health-related research and have made enormous progress in 
specific areas such as the sequencing of the human genome. However, NIH 
investments tend to be focused on the generation and demonstration of new 
research ideas. The comparative advantage of the ATP is its ability to provide R&D 
funds to stimulate specific sectors and companies with tire potential to develop these 
new ideas as commercial products and therefore make them available to a much 
wider group of users. An example of this approach is the ATP support for DNA 
tools, which is converting research findings into methods, devices, and reagents that 
actually work.®® This type of collaboration between the ATP and health researchers 
should continue and expand. 


5“* To a Emited extent, this process already occurs in reverse. Successful applicants to an SBIR program may 
subsequently apply to the ATP. However, firms that do not qualify in an early stage of their development for 
an A IT award may well meet the different criteria for an SBIR award. Tltere are cases where firms have 
progressed from an early SBIR award to an AIT award. See Donna Possum, et al, Viscovsry and Innovation: 
Fedira! Research and Development A ctivities in the Fifty States, District of Columbia, and Puerto Rdco, Science and 
Technology Policy Institute, MR-1194-OSTP, 2000. 

See the statement delivered by jeffrey Schloss on behalf of Francis Collins, the Director of the National 
Human Genome Research Institute at the National Institutes of Health, in the first volume of die Committee's 
review of the ATP. See National Research Council, The Advanced Techmtop Program: Challenges and Opportunities, 
op. cit., pp. 56-59. 

“ Ibid., p. 58. 
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B. Matching Grants by States 

1. In some states, firms that receive ATP awards are currently eligible for 
grants from the state government. The NIST management should establish a 
regular outreach program to coordinate awards after the review process (or 
in conjunction) with state development programs. 

2, Matching State Funds: Consideration should be given to providing 
matching state funds for ATP awardees.” Expanding the ATP's interaction 
with state programs to support high-technology companies within their 
borders would have a number of advantages. Making awards in parallel with 
state governments would: 

a) Increase Certification: First, parallel awards would increase the 
certification impact of the ATP award in the local community by 
raising the firm’s profile at the state level. This certification effect 
can serve to attract private investors by reducing uncertainty 
concerning the quality and potential commercial applications of the 
firm’s technology.” 

b) Leverage Program Funding: Second, parallel awards might 
enable the Advanced Technology Program to reduce the size of its 
base award to individual small business applicants, thereby 
significandy expanding the reach of the program at no additional 
cost. In cases where the award size remains constant, the leverage of 
the award would be significandy and immediately increased by the 
addition of state funds. Cooperation with state programs would have 
the additional benefit of aligning the ATP’s resources with state 
efforts, particularly in existing or nascent technological clusters, 
thereby improving the opportunities for the program and the 
awardees to reach critical mass. 

c) Expand "Best Practice" Selection: The ATP has exceptional 
expertise in the review of technically-sound, commercially-feasible 
proposals by small independent companies and joint ventures 
operating with the advantages of large companies (noted above). 

Care would be required to ensure that an alignment of awards does 
not compromise the ATP’s rigorous selection process. At the same 


The ATP currently refers potential recipients of its funds to state science and technology program offices for 
technical assistance. See C. Ifil, "'fhe Advanced Technology Program: Opportunities for Enhancement," in 
Branscomb and Keller, Investing in Innovation, op. at, p. 165. Positive interactions currently take place beKveen 
state and federal programs such as fhe -ATP. See Marsha R. B. Schachtel and Maryann P. Feldman, Keinjorcing 
Interactions Between the yc^dvanced Technolo^ Program and Stats Technology Programs, V^olume 1: M Guide to State Business 
Assistance Programs for New Technology Creation and CommerciahogitioH, NIST GCR 00-78, .April 2000. 

Feldman and Kelley, The Case for Government Additionality, op. cit., conclude that "winning an ATP award 
significantly increases the firm's success in attracting additional funds from other sources for R&D activities." 
Their findings "provide strong evidence that the ATP award confers a halo effect on winners that makes them 
more likely to attract other funtling when compared to non-winners of the same size. . .with projects of similar 
business and technical quality." 
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time, A'lT cooperation with state agencies would have the advantage 
of leveraging the ATP's expertise in selection and assessment, 
contributing to the quality of the state selection process, and the 
reach of the NIST-based ATP while preserving the current quality of 
the ATP selection and assessment program. 


The Steering 
Committee 


* For the Committee membership, see the front matter. 
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Questions from Senator Coburn 

Hearing on “An Assessment of Federal Funding for Private Research and Development 

(1) Of the organizations that received grants through the Advanced Technology Program since 
1990, what percentage did not seek private funding before requesting grants from ATP? 
Please provide a list of those organizations as well as a list of projects, and the size of their 
respective federal grants, associated with each organization. 

I believe it would be best to direct this question to NIST for a complete answer. The 
Academies have not gathered this information. 

(2) Of the awards granted through ATP since 1990, what percentage focused on research not 
already conducted with private funds in the private sector? 

It would be best to direct this question to NIST for a complete answer. The question 
suggests, however, that ATP is conducting research, whereas it in fact funds research in the 
private sector to be carried out by companies prepared to provide matching funds as a 
testimony to their commitment to and belief in the commercial value of this research. 

(3) Please provide a list and description of every ATP-sponsored project that focused on 
research that was either in the process of being or already had been conducted with private 
funds in the private sector. 

I believe it would be best to direct this question to NIST. We do not collect this information 
at the Academies. It is important, however, to keep in mind that many different technologies 
are explored by many different companies with a wide variety of capabilities and objectives. 
Because ATP involves a self-initiated application process, if is not possible for ATP 
managers to know the state of research and development on a given topic among all 
companies. The objective of the program is to expedite the development of technologies that 
show the promise of broad social benefits. It selects proposals put forward by the private 
sector for matching funds. 

The Congress, through a variety of government agencies, has a long and remarkably 
successful history of funding technologies ranging from the telegraph to radio and airplanes 
to computers, semiconductors, satellites, and the Internet. Together these investments have 
repeatedly transformed the US economy. 

NIST pointed out in its response to the GAO study that applicant firms must demonstrate that 
the proposed solution is particularly innovative relative to alternative approaches being 
pursued by foreign and domestic competitors. This does not necessarily mean they are the 
only possible solutions. Numerous organizations, both government and private, fund projects 
with similar research goals. For example, multiple public agencies and private entities are 
pursuing drugs to combat AIDS. 


1 



213 


What makes each research project unique are the pathways or technical approaches to 
solving the problem. As the NIST leadership has pointed out, there is a distinction between 
funding projects with similar “research goals” versus funding projects with “unique project- 
specific objectives and technical approaches.” 

The reality is that the innovation process is exceedingly complex, involving many dead ends, 
alternative approaches, varying techniques, and always uncertain outcomes. Many times the 
most innovative developments are in fact not the intended objective of the R&D program. 

The spillover effects of developing new platform technologies can be very powerful as they 
are taken up and given different applications in the marketplace. 

(4) How do ATP's selection criteria ensure that ATP-sponsored research is not duplicative of 
past or ongoing private sector efforts? 

There is a distinction to be drawn between duplication and successful research. Multiple 
efforts on multiple paths are often required for “success.” The implied assumption that 
public funds “crowd out” private funds is not sustained by empirical examination.' 

(5) If an applicant has not sought provide funding before requesting federal funds from ATP, is 
that applicant automatically disqualified? 

My understanding is that the ATP does require that firms seek private finance before 
applying to the program. It would be best to direct this question to NIST for a complete 
answer. 

It is important to keep in mind that markets are never perfect. They are normally 
characterized by substantial asymmetries in information, both on the part of the investor and 
potential recipient of such investment. These problems are particularly acute in the case of 
new technologies. It is often hard for the investors to fully grasp the nature of the 
technology and its operation, the technology’s potential contribution, and the scale of the 
market that might thus be available. Even extremely experienced venture capitalists, who 
normally invest in more mature technologies, normally succeed with only around a third of 
their investments. 

(6) Since 1990, how many grants awarded through ATP have gone to publicly-traded 
corporations and what is the cumulative dollar total of those grants? Please provide a 
specific list with each company name and individual grant amount. 

It would be best to direct this question to NIST for an answer. 

(7) Since 1990, what percentage of federal funds appropriated to ATP has been spent by ATP 
on activities not specifically associated with research and development such as marketing or 
promotion? 


See Paul David, Bronwyn Hall, and Andrew Toole, “Is public R&D a complement or substitute for private R&D? 
A review of the econometric evidence," Research Policy 29(4-5); 497-530 (2000). 
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I believe it would be best to direct this question to NIST for a complete answer. 

(8) Since 1990, on average, what percentage of federal funds awarded to each project has been 
spent by grantees on activities not specifically associated with research and development? 

It would be best to direct this question to NIST for a complete answer. 

(9) Since 1990, what percentage of federal funds appropriated to ATP has been spent on 
conferences? Please provide a list of those conferences, including the date, location, and 
amount of federal money spent on each conference. 

While NIST can perhaps provide a more complete answer to this question, it is important to 
recognize that conferences can and do contribute to a better understanding of the state of a 
field of inquiry, help spread knowledge about best practices, and can provide expertise and 
points of comparison to better assess the quality of applicants to a program. Conferences 
can also pennit a better understanding of operational issues, provide opportunities for 
assessment, and help policymakers understand the challenges of early stage finance and the 
contributions of programs like ATP, SBER, DARPA, and HSARPA, all of which seek to 
compensate for market failures in early stage technology. 

(10) How many organizations that conduct research into human cloning or embryonic stem cell 
research have received grants from ATP? Please provide a list of each organization, 
associated project, and size of federal grant. 

It would be best to direct this question to NIST. My understanding is that some of this type 
of research has moved offshore to countries such as the United Kingdom. 

(11) Does ATP calculate the risk, expected rate of return, and actual rate of return on each 
project that receives a grant from ATP? If so, please provide a detailed description of the 
model used to calculate those figures, as well as the results of the calculations for each 
project. Please include the name, company, date, grant amount, and risk and return results 
of each analyzed project. If ATP does not perform these calculations, please provide a 
detailed explanation as to why risk and rates of return are not calculated. 

It would be best to direct this question to NIST for a complete answer. 


Questions from Senator Lieberman 

(I) What information is available on applicants that tried to find funding via avenues other than 
the Advanced Technology Program? 

It would be best to direct this question to NIST for a complete answer. 
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(2) What information is available regarding applicants that were highly ranked by ATP but did 
not receive awards? Specifically, were they successful in receiving outside funding and 
obtaining their original project goals outlined in their ATP applications? 

Firms that receive ATP awards are significantly more successful in obtaining additional 
funding than non-winners. This “halo effect” from the ATP award is independent from the 
ratings of the project. The majority of the companies (62%) that apply to ATP and do not 
receive support generally do not proceed with the project. 

A little more than a third of applicants do begin work on the proposed project but in most 
instances (over 75%), the project is pursued at a smaller scale. These results suggest that for 
the most part, ATP is attracting applicants that need support in order to proceed with their 
R&D plans. 

(3) In general, what data is available regarding available funding for early stage development, 
particularly the % of available VC funding? 

Despite the size of the U.S. venture capital market, little of it is available for early-stage 
funding. As noted in my testimony presentation and illustrated in the figure below, of the 
$20.9 billion in U.S. venture funding in 2004, only S346 million (1.65%) was available for 
startup/seed capital. See also the response to Senator Laughtenberg (Question 5, second 
bullet) below. 


Large U.S. Venture Capital Market is 

Not Focused on Early-Stagc Firnts 
Breakdown of U.S. Venture Capital by Stage of 
Development-2004 


I $34 6 millio n 



165% ^,^Startup/Seed 

18.55% 


['■ Total = $20.? billion 


!□ Startup/Seed ■ ^rly Stage □ Expansion □ Later 


Stage j 


THE NATIONAL ACADEMIES 

iilmtn to tin Holm en Sdtoa, Sitfeittimg onti Ht&hi 


Charles W. Wessner, PhD 


SOURCE: PricewaterhouseCoopers/Thompson Venture Economics/ National Venture Capital 
Association MoneyTree Survey, 2005 
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Venture funding, by its very nature, tends not to invest in early-stage, enabling technologies. 
In the course of the Academies’ deliberations, David Morgenthaler, former president of the 
National Venture Capital Association, stated, “It does seem that early stage help by the 
government in developing platform technologies and financing scientific discoveries is 
directed exactly at the areas where institutional venture capitalists cannot and will not go.”^ 

The remainder of this question might be better directed to NIST, 

(4) Please comment and provide any documentation addressing NIST’s evaluation of the GAO 
2000 study. 

The GAO 2000 report was the basis for Ms. Nazzaro’s testimony. Although NIST was not a 
witness at this hearing, I cited the NIST director’s evaluation of this partial study of the 
program and was encouraged to include excerpts from the NIST response by the Chairman. 
See below. 

NIST’s response to GAO report Advanced Technology Program: Inherent Factors in 
Selection Process Could Limit Identification of Similar Research, GAO/RCED-00-114 
(Washington, D.C.: April 24, 2000) 

Scope and Methodology 

The GAO examined 3 of 38 completed ATP projects from ATP’s status report entitled 
Performance of Completed Projects, dated March 1999. These projects were chosen from the 
following technology sectors; information, computers, and communication; electronics; and 
biotechnology. These three technology sectors represent 26 of the 38 completed ATP projects, or 
68 percent. 

GAO Comment: Three ATP Projects Addressed Similar Research Goals to Projects in the 
Private Sector 

Methodologically, it is important to recognize the selection bias inherent in the small sample, 
less than 8% of completed awards, taken by GAO. Generalization about the program as a whole 
on the basis of these three projects is not warranted. The underlying assumption that it is 
inappropriate to have any overlap between ATP-funded research and private sector-funded 
research is also unwarranted. 

As noted above, the innovation process is neither simple nor linear. Multiple approaches are 
desirable. It is for this reason that ATP criteria allow for the funding of competing approaches to 
addressing established industry-identified market needs. 

As most researchers would recognize, there can be several research approaches to addressing the 
same problem. Successful proposals must effectively balance high technical risk with evidence 
of scientific and/or engineering feasibility for overcoming that risk. Proposers must discuss why 
the proposed solution has not been previously attempted or accomplished. ATP requires that 


^ Managing Technical Risk Understanding Private Sector Decision Making on Early Stage Technology-based 
Projects, NIST OCR 00-787, April 2000, p49 
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they demonstrate that the proposed solution is particularly innovative relative to alternative 
approaches being pursued by foreign and domestic competitors. 

This does not necessarily mean they are the only possible solutions. Numerous organizations, 
both government and private, fund projects with similar research goals. This does not mean they 
are funding the identical technical approach to attain the research goal. What makes each 
research project unique are the pathways or technical approaches to solving the problem. There 
is a distinction between funding projects with similar “research goals” versus funding projects 
with “unique project-specific objectives and technical approaches.” 

As an example, NIST reports that in 1991, ATP officials gave the Communications Intelligence 
Corporation (CIC) $ 1 .2 million for initial research into computer recognition of cursive 
handwriting, although similar (not identical) technology had already been developed, patented, 
and marketed. Many other companies were concurrently improving that technology, resulting in 
450 new patents. However, the taxpayers’ investment ultimately proved successful. In 2002, the 
company reached an agreement to license their technology into the Palm 0/S. The software is 
also part of smart phones produced by Sony Ericsson, as well as other products. In recent market 
surveys, CIC has emerged as the leading supplier of biometric signature verification technology. 

A study of patents demonstrates that technology developed under ATP is innovative. NIST 
reports that through FY 2003, ATP funded projects have filed 1,171 patents. A patent cannot be 
granted for anything that is part of the state-of-the-art, which is everything that has been made 
available to the public to date. Similarly, ATP projects have submitted 1,245 technical 
publications through FY 2003. These publications are a means to communicate research 
approaches and results to the technical community. They also provide an indicator to help 
safeguard against continuing to fund work duplicated elsewhere. 

The fundamental point is that it is reasonable and appropriate that the Federal government should 
fund research that shares the same overall goal as research funded outside the government. If 
not, then Federal research on cures for cancer, AIDS, and a host of other diseases, wireless 
communications, computing technologies, manufacturing, etc. would be ended. 

GAO Comment: ATP’s Current Award Selection Process Is Unlikely to Avoid Funding 
Similar Research 

• ATP’s Conflict-of-interest Provision Limits Its Ability to Identify Similar Research 

• Proprietary Information Limits ATP’s Ability to Identify Similar Research 

Response: 

ATP’s peer-reviewed selection process is designed to ensure that funding is given to companies 
proposing new approaches to industry-identified goals. Patent and scientific literature searches 
are performed. A patent search, especially, provides insight into the state-of-the-art of a 
technology. The U.S. Patent Office includes some of the world's largest public patent databases 
containing recently published patent literature from top companies and individual inventors 
throughout the world. 
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Technical experts are selected from government agencies to review proposals. ATP matches 
these technical reviewers with proposals based on their subject matter expertise and familiarity 
with the state-of-the-art. Federal scientists, especially at NIST, have strong ties to industry and 
the work they are conducting. If a reviewer must recuse themself from reviewing a particular 
proposal, it is usually because they are working on a very similar line of research. In these 
instances, another expert is identified and matched with the proposal. A Source Evaluation 
Board (SEB), composed in part of scientists and engineers, discusses the relative merits of each 
proposal before making recommendations to funding officials. 

It should be noted that not all privately funded technology is widely or ever marketed. In some 
instances, technology is held for the exclusive benefit of a few companies; in other cases it is 
shelved altogether. In these cases, the market may not always allocate scarce resources 
efficiently in a way that achieves the highest total social welfare. If the technology is not in the 
public domain, there are no broad economic benefits. All projects funded by ATP must have the 
potential for broad-based economic benefits and a clear pathway to those economic benefits. 


Questions from Senator Laughtenberg 

(!) Has ATP made changes to address the issues identified in GAO’s 1996 report? Are there 
more recent examples of supposedly problematic projects than those identified by GAO and 
Heritage? Why haven 't they been cited? 

• NIST argues that the 1996 GAO study results support the conclusion that ATP is meeting 
its objective of funding projects that either would not be pursued at all or projects that 
would have been pursued without ATP funding, but at a much slower pace. This point is 
supported by the analysis prepared by Professor M.P. Feldman and Dr. M.R. Kelley in 
the Academies 2001 report on the Advanced Technology Program, “The Advanced 
Technology Program: Assessing Outcomes.” 

• It is our understanding that since the late 1990s, ATP has explicitly asked all applicants to 
“describe what efforts were made prior to applying to ATP funding to secure private 
capital to support this project wholly,” conducted thorough patent and literature searches 
to augment its expert-board deliberations; and, evaluated whether similar projects were 
taking place through CRADAs in the ATP laboratories. 


(2) Is it accurate that only one-third of ATP projects successfully bring new projects to market? 
If that is accurate, isn t the purpose of ATP to fund high-risk, high-reward projects, meaning 
that a large number of projects are expected to fail, and that 's a price we 're willing to pay 
because the projects that succeed do so spectacularly? 

• It is misleading to emphasize that “only” 1/3 of ATP projects are successful. This 
implies that the Program should be more successful when in fact a higher success rate 
would suggest that it is not funding high risk R&D. 

• It is accurate to state that roughly more than 1/3 of ATP’s projects had new technologies 
under commercialization as of the end of FY2003 (i.e., 271 out of 709 or 38%). 
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• Yes, it is reasonable to expect a high percentage of ATP projects to fail to reach all of 
their technical objectives, given the high-risk nature of the R&D work funded. Some of 
what ATP describes as its “failures” add to the nation’s technical knowledge base and 
some programs that initially found no immediate utility later proved extremely useful, as 
with the mirrors used for EUV lithography. In any event, project failures are in no way 
indicators of program failure. 

(3) How many jobs does ATP support and create each year? 

• Job creation is not a major goal of ATP and is therefore not a metric that has been 
traditionally used to judge ATP success. Anecdotal evidence suggests that ATP co- 
investment in early-stage technologies may over time help catalyze industries such as 
biochips and successful projects such as the project on printed wiring boards and the 
2mm automotive project appear to have contributed to the competitiveness of the 
industries and therefore to job retention, at least for a time. 

(4) When A TP and private sector fund similar research, does that improve the speed of 
development and thus yield economic benefits? 

• Project participants indicate that they were significantly advanced as a result of ATP 
funding. 

• In addition, firms that receive ATP awards are significantly more successful in obtaining 
additional private funding than non-winners of ATP awards. This “halo effect” from the 
ATP award suggests the private sector places a value on successful completion of NIST’s 
highly competitive application process. 

The majority of the companies (62%) that apply to ATP and do not receive support 
generally do not proceed with the project. A little more than a third do begin work on the 
proposed project but in most instances (over 75%), the project is pursued at a smaller 
scale. These results suggest that for the most part, ATP is attracting applicants that need 
support in order to proceed with their R&D plans. 

(5) Does America still face competitive pressures from abroad, from countries like China and 
India? Would it be a mistake to say that ATP is no longer necessary because America no 
longer faces competitive pressures from abroad? 

• Unparalleled Competition. The global economy is creating competitive pressures that 
are unparalleled and certainly stronger than they were at ATP’s inception. Today’s 
competitors now include China and India as well as Japan and a host of other countries 
large and small, such as Korea, Taiwan, Singapore, Germany, Finland, and Brazil. The 
diversity and strength of the competition from established and emerging participants in 
the global economy pose significant and unprecedented competitive challenges for the 
United States. 

In such an environment, the ATP continues to fill a widely-recognized financing gap 
between basic research, where the U.S. spends $132 billion per year, and product 
development that, over time, can make significant contributions to U.S. competitiveness. 
It is an exceptional federal program designed specifically to promote long-range, high 
risk R&D in industry, thus enabling a higher rate of innovation in areas most likely to 
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bring broad economic benefits to the nation. Given industry’s increased emphasis on 
short-term applied R&D and consequent reduced emphasis on early-phase (generic) 
technology research, this modest but effective program helps fill an important gap in 
early-stage finance. 

• Foreign Innovation Programs. In addition to the competitive pressures from emerging 
markets such as China and India, most of our industrial competitors, including the 
European Union, Canada, Germany, Japan, and Finland have programs similar to the 
ATP in concept and often larger in scope and funding. All are viewed as an appropriate 
vehicle to promote innovation. 

o The European Union’s Sixth Framework Program (FP6) for Research and 

Development (2002-2006) promotes multi-country R&D collaboration of the ultimate 
creation of a European Research Area. The FP6 directs is 17.5 billion euros to six 
priority areas, including life sciences, nanotechnology, information society 
technologies, and sustainable development. 

o In Canada, the Technology Partnerships Canada (TPC) program (founded in 1996) 
provides funding to small- and medium-sized firms for projects in environmental, 
aerospace and defence, and enabling technologies, 
o In Germany, the Ministry of Economics and Labor (BMW A) supports basic and pre- 
competitive research, with special emphasis on small and medium-sized firms located 
in the former East Germany. 

o In Japan, the “Teian-Kobo” competitive grant system (started in 1995) for pre- 
competitive technology shares some similarities to ATP. 
o In Finland, the Ministry of Trade and Industry’s Technology Development Center 
(Tekes) promotes the technological competitiveness of Finnish industry through 
grants and other financial support for challenging and innovative projects. 

(6) When a grant goes to a Fortune 500 company, does that necessarily mean that it is 
corporate welfare? Or does the federal government have a proper role in providing 
matching funds to large companies under programs like ATP? 

• Corporate Welfare? The use of the term “corporate welfare” is misleading. The ATP 
is not an entitlement program. It does not provide support for a class or category of 
firms. It is a highly competitive award program, very similar to competitive scholarships 
that involve both personal and societal benefits. Less than 1 5% of the applicants win 
awards, and the awards are limited in time and amount. Consequently, the program does 
not breed dependency. Each project is finite in duration, with a maximum of five years. 

• Federal Success in Technology Development. The federal government has a 
longstanding role in providing funding to large companies to develop new technologies, 
sometimes for military use, often for civilian applications. ATP supports leading-edge 
high-risk R&D on potentially important enabling technologies that have the potential to 
provide significant economic benefits to the U.S. 

• Valuable Contributions of Large Companies. Large companies can be a major asset 
for the program, and can play an important role in bringing technologies developed in 
joint ventures forward to the market. Large companies offer significant advantages in 
certain industries and technology areas such as management expertise, marketing and 
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manufacturing capability, access to distribution channels, branding, and the ability to 
encourage collaborative R&D ventures. 

• Cost-Sharing with Industry. ATP funds efforts that would not be undertaken with 
private funds alone and requires cost-sharing from industry, Companies involved must 
contribute significant resources; on average, about half the funding for ATP projects 
comes from private industry. For joint ventures, half or more of the funding must be 
provided by the companies. When applying on their own, large firms are required to 
provide a 60% cost-share. 

• The Role of Small Companies. Approximately 66% of ATP funds go to small 
business. 

• Joint Ventures. While large companies sometimes participate in ATP awards -- 
particularly in joint ventures - so do hundreds of small and medium-sized companies. 
Most large companies participate in collaborative joint R&D ventures with small 
businesses, universities and non-profits. 
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